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ABSTRACT 

The report to Congress on the management of the 
Federal Jffice of Special Education and Rehabilitation Services 
(OSERS) explains findings grouped into five major areas: (1) goal 
setting, (2) performance management, (3) human resources management, 
(4) grants management, and (5) federal/state relationships. 
Questionnaires concerning the management of OSERS were sent to 250 
field managers and senior staff, and 187 completed surveys were 
received and analyzed (a response rate of 75%). In addition, 
telephone interviews were conducted with state directors of 
vocational rehabilitation and state directors of education. Finally, 
preliminary findings were discussed with component heads and selected 
division directors and branch managers. Among findings were the 
following: OSSRS management has done a poor job of establishing 
0SERS-V7ide goals, and specifically, OSERS lacked; (1) a goal-setting 
process that incorporated input from each OSERS component; and (2) a 
formal tracking system to monitor goal implementation. The management 
of OSERS » components is difficult to measure because of a lack of 
componentwide strategic plans. In human recources management, some 
progress has been made in filling vacanciss with continuing problems 
in inadequately trained staff and accessibility of training. Serious 
problems were identified in OSERS evaluation and monitoring of 
grantee performance in both discretionary and formula grants. 
Questionnaire respondents and interview subjects also tended to have 
negative responses to questions concerning federal/state 
relationships. Seven appendixes and 31 figures provide supportive 
information and statistical data. (DB) 
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November 28, 1989 

The Honorable Major R. Owens 
Chairman, Subcommittee on 

Select Education 
Committee on Education and Labor 
House of Representatives 

Dear Mr. Chairman: 

In meetings with us, you and Subcommittee staff expressed concerns 
over the management of the Department of Education's Office of Special 
Education and Rehabilitative Services (osers) programs and activities. 
You later asked us to obtain the views of osers managers and senior 
staff regarding how well key management activities were being carried 
out within OSERS. We briefed you, the Subcommittee's Ranking Minority 
Member, and Subcommittee staff on February 8, 1989. After that brief- 
ing, we did some additional work in order to clarify and expand on our 
survey results. We testified on osers management issues before the Sub- 
committee on September 7, 1989. 

This report sunmiarizes and expands on our February briefing and 
recent testimony. Our findings are divided into five major areas: (1) goal 
setting, (2) performance management, (3) human resources manage- 
ment, (4) grants management, and (5) federal/state relationships. 

Our work was limited to obtaining perceptions concerning osers manage- 
ment activities. In conducting our work, we did not look at these activi- 
ties from a departmentwide perspective; consequently, we are making 
no recommendations to the Secretary at this time. However, we plan to 
initiate a compreheasive review of departmental management practices 
in fiscal year 1990. This review will expand on our discussion in Educa- 
tion Issues (GA0/0CG-89-18TR, Nov. 1988) on the need to establish a secre- 
tarial management system. 



In fiscal year 1989, the Congress appropriated $3.7 billion to the Depart- 
ment of Education for federal special education and rehabilitative ser- 
vices programs. These progr ams are administered through osers, whose 
primary mission is to award grants to help disabled persons gain 
employment, to assist states in providing handicapped children with a 
free appropriate public education, and to support rehabilitation 
research. Program activities are carried out by osers' three major com- 
ponents: the Rehabilitative Services Administration (rsa), the Office of 
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Special Education Programs (OSEP), and the National Institute on Disabil- 
ity and Rehabilitation Research (nidrr). The Office of the Assistant Sec- 
retary for Special Education and Rehabilitative Services (gas) provides 
overall guidance and direction to these components. (See p. 10.) 

In August 1988, we mailed a ruestionnaire to 250 OSERS headquarters 
and field managers and senior staff to obtain their views on osers man- 
agement. We received 187 completed questionnaires for an overall 
response rate of 75 percent. In addition, we conducted structured tele- 
phone interviews with state officials who implement programs receiving 
OSERS funding— state directors of vocational rehabilitation and state 
directors of special education. After analyzing the questionnaire results, 
we discussed our findings with component heads and selected division 
directors and branch managers to gain additional insights into OSERS 
management practices. (See p. 12.) 



More than 60 percent of the osers questionnaire respondents said that 
the Office ox the Assistant Secretary had done a poor job of establishing 
osERS-wide goals, coordinating activities among components, and 
responding to program concerns raised by senior officials, regional 
offices, and constituents. State officials had mixed views regarding the 
establishment of osers goals. Most state special education directors 
believed that the Assistant Secretary did a good job in choosing broad 
goals on which to concentrate osers efforts, but state rehabilitation 
directors were generally dissatisfied with this effort because, among 
other things, their input was excluded from this process. 

Between March 1984 and November 198G, the former Assistant Secre- 
tary for Special Education and Rehabilitative Services^ established 
several broad areas upon which to concentrate osers activities — 

(1) transition from school to work for students with disabilities, 

(2) supported employment for adults with severe disabilities, and 

(3) education of students with learning disabilities. The former Assis- 
tant Secretary informally monitored osers' progress in achieving these 
goals principally through discussions at weekly staff meetings and by 
tracking the timeliness of component actions in completing various 
tasks. 

During our osers work, we identified management deficiencies similar to 
the departmentwide weaknesses on which we reported in our November 
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1988 report. Specifically, despite efforts by the Office of the Assistant 
Secretary to establish broad goals and track progress in meeting these 
goals, OSERS lacked (1) a goal-setting process that incorporated input 
from each osers component, and (2) a formal tracking system to monitor 
implementation of key goals and objectives. In commenting on the devel- 
opment of the broad goals established by the former Assistant Secre- 
tary, the majority of osers managers and senior staff said the Office of 
the Assistant Secretary generally did a poor job in terms of involving 
appropriate component staff in the goal-setting process, making timely 
decisions, and considering alternatives. (See p. 17.) 



The performance of osERS components is difficult to measure because 
these components do not develop componentwide strategic plans^ with 
specific goals and objectives. Instead, components generally develop 
what we would characterize as operational plans^ which are consistent 
with the broad goals established by the former Assistant Secretary, but 
which lack clear program objectives that can be subsequently measured 
to determine whether planned objectives are achieved. Only rsa had 
developed strategic program plans with specific goals and measurable 
objectives in fiscal years 1986-88, but such a plan was not developed for 
fiscal year 1989 because of leadership and staffing changes within rsa. 
(See p. 20.) 



One hundred and nine of our questionnaire respondents at the organiza- 
tional unit level (divisions and branches within osers components^ were 
aware that their units had operating plans, of which 79 percent believed 
the plans helped them to better execute their day-to-day activities. 
However, many of these respondents cited barriers to successful imple- 
mentation of unit level plans, such as insufficient staff to carry out 
important functions and inadequate authority to make needed decisions. 
Eighty-one percent of the questionnaire respondents stated that many of 
OSERS' operational practices had negatively affected their ability to prop- 
erly manage their day-to-day activities. One example cited frequently 
was the former Assistant Secretary's direct involvement in approving 
travel for component personnel (See p. 24.) 



^Strategic plans aro plans developed to (a; analyze organizatiunal environment, (bj assess organiza- 
tional strengths and weaknesses, (c) consider alternatives, (d) establish clear objectives, (e) assign 
responsibility, (0 link planning efforts, and (g) establish feedback mechanisms. 

'^Operational plans are annual plans prepared in support of anticipated budget expenditures. 
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Human Resources 
Management 



With respect to filling vacancies, 55 percent of questionnaire respon- 
dents said their components seldom could fill critical vacancies when 
they occur. Respondents also indicated that employee turnover had 
decreased the number of qualified staff in their units, decreased osers 
efficiency and effectiveness, and greatly decreased employee morale. In 
addition to osers managers, many state directors for rehabilitative ser- 
vices (37) and state directors for special education (31) told us that 
vacant osers managerial positions and i> arsons functioning in acting 
capacities were having a negative effect upon state programs because, 
among other things, program decisions were being postponed. 

In following up on these concerns, we found some progress being made 
in filling vacancies. As of February 1988, 21 of 56 key osers positions 
(such as component heads, division directors, and branch managers) 
were vacant or being filled on an acting basis because of (a) various per- 
sonnel procedures, such as the inability to pay relocation expenses for 
new hires, (b) limited promotion potential, and (c) uncooperative osers 
administrative staff. As of February 1989, 14 of 56 key positions 
remained vacant or filled with acting managers. 

Inadequately trained staff was cited repeatedly as a problem by both 
OSERS employees and state officials. Yet, only 15 oercent of the respon- 
dents said that Department-sponsored internal training and develop- 
ment programs were effective in improving the performance of 
participating employees. Respondents believed training was ineffective 
because training courses offered to osers headquarters staff through the 
Department's Horace Mann Learning Center in Washington, D.C., 
included managerial and administrative courses only; the center does 
not offer training in specialized subject matter, osers' regional staff told 
us they could not attend management courses at the center because 
funds were unavailable to pay their travel costs or per diem expenses. 
In addition, osers officials told us that travel funding to attend out-of- 
town seminars and training conferences was difficult to obtain because 
of budget restrictions. (See p. 28.) 



Respondents identified a variety of human resource management prob- 
lems within their components. For example, more than 75 percent of the 
respondents indicated that staff vacancies, staff in acting management 
positions, and the lack of appropriate training courses and/or access to 
training were problems. 
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VirtuaUy all (91 percent) of OSEPS' $3.7 billion fiscal year 1989 budget is 
aevoted to the award and administration of discretionary and formula 
grants/ However, 58 of 119 questionnaire respondents with grant 
responsibilities identified inadequate OSERS evaluation and monitoring of 
grantee performance as serious problems in both discretionary and 
formula grants. (See p. 33.) 



OSERS awarded 2,366 discretionary grants totaling $338 million during 
fiscal year 1988.^ However, only 5 percent of the discretionary grant 
recipients received an on-site monitoring visit by OSERS officials during 
the year. Telephone discussions with grantees ;vere the most common 
monitoring method. Many respondents told us that telephone monitoring 
is used in place of site visits because of limited travel budgets. However, 
the disadvantage to relying on telephone monitoring is the lack of on- 
site verification of grantee perform.ance. (See p. 35.) 



Formula Grants regard to the $3.3 billion in formula grants that OSers administers, 57 

percent of the questiomiaire respondents with formula grant responsi- 
bilities believed monitoring of these grants was inadequate. This prob- 
lem seemed to be most prevalent in the Office of Special Education 
Programs, which administers the Education of the Handicapped Act 
program. 

Grantee data (provided to us by OSERS officials) show that formula 
grants awarded to 13 of 51 state education agencies were not evaluated 
by OSERS personnel during fiscal years 1985 through 1988. Insufficient 
travel funds and staff vacancies were cited by respondents as the pri- 
mary causes of this problem. 

When monitoring visits were made, formal monitoring feedback was 
delayed for long periods. In fact, 22 state special education directors 
said it sometimes took 18 months or longer to receive a final monitoring 
report from osers. (See p. 38.) 



''OSERS discretionary grants are distnbutcd competitively based on proposals submittxjd by prospec- 
tive grantees. OSERS formula grants are distributed to states based on statutory provisions that 
require allocations to be made on the basis of certain criteria, such as the number of handicappea 
children in each state who are receiving special education and related services. 

^Data unavailable for fiscal year 1989. 
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State special education and vocational rehabilitation directors identified 
several problems regarding their states' relationship with osers. For 
example, as discussed previously, most special education directors were 
concerned about the level of program monitoring carried out by the 
Ofiice of Special Education Programs. Vocational rehabilitation direc- 
tors were critical of osers program direction, policy guidance, and RSa's 
technical assistance. 

Most state vocational rehabilitation directors viewed the Office of the 
Assistant Secretary and rsa's central office as lacking commitment and 
support for rehabilitation programs. In fact, 80 percent of the state 
vocational rehabilitation directors stated that the partnership between 
their state agencies and rsa headquarters officials has deteriorated or 
ceased to exist in the last few years. 

Written federal policy guidance provided to the states by osep and rsa 
was generally characterized as moderately useful but untimely. Of the 
51 state special education directors, 33 told us that the written policy 
guidance received from osep was untimely. Similarly, 43 of 51 state 
vocational rehabilitation directors said rsa's policy guidance was 
untimely. 

Both state vocational rehabilitation and special education directors v. ere 
critical of osers technical assistance efforts. Many state vocational reha- 
bilitation directors also said that on-site technical assistance provided 
by RSA staff was ineffective. Although requests for technical assistance 
continued to be made, oas frequently denied such requests, primarily 
because of insufficient travel funds. In regard to osep, it was osers pol- 
icy for headquarters persoroiel to limit technical assistance to sending 
copies of pertinent information to state officials. On-site technical assis- 
tance was supposed to be provided by the Department's regional 
resource centers. (See p. 41.) 



Agency Comments ^^^^^^ ^^^^^ September 5, : 989, the Department of Education said it 

generally agreed with our findings and discussed its planned actions to 
address the management concerns we identified. (See app. \^J.) 
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As arranged with your office, we are sending copies of this report to the 
Secretary of Education, the Office of Management and Budget, and other 
interested parties. Please call me on (202) 275-5365 if you or your staff 
have any questions about this report. Other major contributors are 
listed in appendix VIL 

Sincerelj^ yours. 




William J. Gainer 
Director, Education and 
Employment Issues 
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Background ^" ^^'^^> "^^^^ the Department of E lucation was created, the Congress 

established the Office of Special Education and Rehabilitative Services 
(OSERS) to bring together federal education and training programs 
designed to assist handicapped individuals. These programs were for- 
merly the responsibility of the Department of Health, Education, and 
Welfare. 

OSERS has tiiree major components: the Office of Special Education Pro- 
grams (OSEP), the Rehabilitation Services Administration (rsa), and the 
National Institute on Disability and Rehabilitation Research (nidrr) The 
Office of the Assistant Secretaiy for Special Education and Rehabilita- 
tive Services (qas) provides overall guidance and direction to fhese 
components. 

OSEP provides grants to states to assist them in providing a free appro- 
priate public education and related services to children with handicaps. 
RSA provides funds to state vocational rehabilitation agencies to help 
physically and mentally disabled persons become gainfully empioyed 
NIDRR provides discretionaiy grants to states, public and pn/ate agen- 
cies, and other organizations to support the conduct cf research, demon- 
stration projects, and related activities, including training of persons 
who provide rehabilitation services or conduct rehabilitation research 
(See fig. 1.) RSA is the only osers component with regional staff to help 
carry out its responsibilities. 

All three component heads report to ihe Assistant Secretaiy for Special 
Education and Rehabilitative Services. The commissioner of rsa and the 
director of nidrr are both presidential appointees. 

OSERS' fiscal year 1989 budget appropriation was $3.7 billion, which 
represents about 17 percent of the total Department of Education 
budget, as shown in figure 2. osers had a staff allocation of 424 full-time 
personnel in fiscal year 1989—135 in osep, 213 in rsa, 33 in nidrr, and 
43 in OAS. 
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GAO Components' 
Primary Missions 



•RSA provides funds to help 
disabled persons gain 
employment 

«OSEP awards grants to 
provide handicapped children 
with a free appropriate 
public education 

•NIDRR provides grants to 
support rehabilitation research 
and related activities 
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Figure 2 



GAO Department of Education's 
FY 1 989 Budget 

• 17% Devoted to OSERS 



5% 

Vocational and Adult - $1 .1 billion 
3% 

aher-$0.7billbn 




- OSERS -$3.7 billion 



Elementary and Secondary - $6.6 billion 



Postsecondary - $9.8 billion 



Objectives, Scope, and 
Methodology 



During November 1987 oversight hearings and in our later meetings 
with the Chairman, Subcommittee on Select Education, House Commit- 
tee on Education and Labor, and the Subcommittee's staff, concern was 
expressed over the management of one of osers' three organizational 
components, rsa. In a February 1988 meeting with the Subcommittee 
Chairman and his staff, we agreed to obtain the perceptions of osers 
managers and senior staff regarding selected management activities. 
Such a study was expected to aid the Subcommittee in its oversight 
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Figure 3 



GAO Survey of OSERS 

Management Activities 



Objectives 

•Identify potential problems in 
selected management activities 

« Determine possible effects on 
state agencies 

•Report results to Congress 
and the new administration 



function and be useful to the key agency heads of the new adminis- 
tration. (See fig. 3.) 

During August 1988, we mailed a ouestionnaire to 250 managers and 
senior staff in OSERS. To obtain candid answers we promised these indi- 
viduals that all information collected would be kept confidential and not 
be linked with individual employees. 

The questionnaire was developed, in part, using questions designed by 
our office for earlier departmentwide management studies at the 
Departments of Labor and Health and Human Services. It was modified, 
however, to reflect OSERS' specific management systems based on com- 
ments from former and current officials of OSERS' three organizational 
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Figure 4 



GAO Manager and Senior Staff 
Questionnaire 



Response Rates by 
OSERS Components 



OAS 



RSA 




CWEP NIDRR 



components. We pretested the questionnaire with managers in all 
three osers components and provided copies of the draft question- 
naire for review to osers officiaL and the Department's Office of 
Legislation, Office of General Counsel, and Office of Planning, 
Budgeting, and Evaluation. The questionnaire was then revised to 
incorporate, to the extent we considered appropriate, all relevant 
comments. 
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Figure 5 

GAO Study Methodology 



Manager and senior staff 
questionnaire 

State director telephone 
interviews 

Component interviews and 
follow up analysis 



We received 189 questionnaires of the 250 distributed, but 2 question- 
naires were incomplete. As a result, we included 187 in our analysis for 
a response rate of 75 percent. The percentages of questionnaires 
returned to us by individuals in gas and each OSErs component are 
shown in figure 4. 

We also used structured telephone interviews to obtain the views of 
state officials who interact with osers staff and implement osers 
programs — namely, state directors of vocational rehabilitation and of 
special education. We asked them to evaluate the leadership, respon- 
siveness to state needs, and quality of services provided by OSErs. 

In addition, we briefed the Chairman and Ranking Minority Member of 
the House Select Education Subconmiittee on our study results on Febru- 
aiy 9, 1989. We also (1) met with each component head to present our 
findings, (2) held discussions with several groups of division directors 
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Figure 6 



GAO Management Activities 
Reviewed 



9 



9 



Goal Setting 



Performance Management 



• Human Resources Management 

• Grants Management 

and branch chiefs to obtain certain additional information, and 
(3) requested additional documentation from osers officials in order 
to clarify and expand upon information provided in the initial phase 
of our assignment. (See fig. 5.) 

Figure 6 shows the m^or management activities our study addressed. 
Goal setting, performance management, and human resources manage- 
ment were selected because they are important functional areas of an 
agency's operations, our experience in reviewing various agency opera- 
tions has shown. Grants management was added because that is one of 
OSERS' primary activities and absorbs the vast m£uority of its resources. 
Our work was limited to obtaining the perceptions of osers management 
activities. In conducting our work, we did not look at these ac.ivities 
from a departmentwide perspective; consequently, we are making no 
recommendations to the Secretary. 

Our study was done from February 1988 through April 1989 in accord- 
ance with generally accepted government auditing standards. 
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Figure 7 



GAO OSERS Goal Setting 



OSERS process lacked 

•Input from OSERS components 
in establishing goals 

•Systematic means to track 
progress in meeting key 
goals and objectives 



OAS performed certain OSERS-wide goal-setting and tracking functions. 
OSERS managers and senior staff said, however, that the goal-setting pro- 
cess did not include input from OSERS components. In addition, there vi^as 
no tracking system to monitor implementation of key goals and objec- 
tives. (See fig. 7.) 



Goal Setting and 
Tracking 



During her tenure from July 1983 through May 1989, the former Assis- 
tant Secretary established three broad goals or initiatives. (See fig. 8.) 

A national priority on improving the transition from school to working 
life for all individuals with disabilities was established by the former 
Assistant Secretary and described in an article published in the March/ 
April 1984 issue of Programs for the Handicapped , Clearinghouse on the 
Handicapped. The support for the employment of adults with severe 
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Figure 8 



GAO OSERS Goals: 

Fiscal Years 1 985-89 



Broad Goals Set by 
Former Assistant Secretary 

• Transition from school to work 
for students with disabilities 

• Support for employment for 
adults with severe disabilities 

• Education of students with 
learning disabilities 



disabilities initiative was described in a fiscal year 1985 osers position 
paper, intended for review by interested parties while the program was 
being coiisidered by the Congress. Increasing the educational success of 
children with learning problems was established as an osers goal and 
published in a November 1986 booklet written by the former Assistant 
Secretary. 

Although broad goals were established, the majority of respondents to 
our questionnaire said gas generally did a poor job of involving appro- 
priate staff, making timely decisions, considering alternatives and the 
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Figure 9 



GAO Respondents Critical of 
Goal-Setting Process 

More then 60 percent believed 
OAS has done a poor job 

•Establishing realistic 
objectives 

•Coordinating activities among 
components 

•Responding to concerns of 
senior managers and others 

long-term effects of decisions, and coordinating with OSERS compo- 
nents during the goal formulation process. More than 60 percent of 
the respondents said gas did a less-than-adequate job of establishing 
broad program priorities for each component. For example, respon 
dents said that gas did a poor or very poor job of (1) establishing 
realistic GSERS-wide goals and objectives, (2) coordinating activities 
requiring cooperation between GAS and the components, and (3) 
responding to major concerns surfaced by senior managers, regional 
offices, and constituents. (See fig. 9.) 
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While OSERS initiatives generally related to the broad goals established 
by the former Assistant Secretary, ^o component subobjectives were 
identified, and no milestone dates were established. Because no sub- 
objectives were established, no one was held responsible for carrying 
them out. Also, there was no process for routinely involving key osers 
managers and staff in the goal-setting process. 



Tracking Implementation Progress in achieving OSERS goals was monitored by the former Assistant 
of OSERS-Wide Goals Secretary principally through discussions at weekly meetings with top 

OSERS component officials and managers and by tracking the timeliness 
of component actions in completing Vc is tasks, such as awarding dis- 
cretionary grants, osers officials told us v. 'at components did not pro- 
vide progress reports, and minutes of the weekly meeting discussions 
were not maintained to provide the former Assistant Secretary with a 
record of the osers components' progress. Officials told us feedback 
from OAS to OSERS officials was informal or consisted of weekly memos 
from OAS officials to alert them of approaching deadlines. 



Management at 
Component Level 



In reviewing the management of component organizations, we had trou- 
ble measuring their performance because osers components do not 
establish componentwide strategic plans (see p. 3) with measurable 
objectives that are approved and then monitored by OAS. Instead, each 
component develops operational plans (see p. 3) that generally are 
linked to the broad osers goals established in the mid-1980s by the for- 
mer Assistant Secretary. Each OSERS component informally planned its 
own activities. (See fig. 10.) 



Components Lack None of the ose'rs components developed strategic plans with measura- 

Strategic Plans performance objectives in fiscal year 1989. rsa had strategic plans 

for fiscal years 1986-88 but did not develop a plan for fiscal year 1989 
because of leadership and staffing changes within rsa. Other compo- 
nents' plans we reviewed were operational plans that focused on the 
annual budget process. 
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Figure 1 0 

GAO Management at 
Component Level 

According to component 
management: 

•Components generally 
develop operational plans 

•Planning process varies 
among components 

•Planning process appears 
linked to OAS goals 



RSA Strategic Planning Initiative During fiscal yearb 198G-88, ix^a initiated an ambitioub planning project 

that included 

• a formal statement of philosophy and three broad goals for RSa; 

• an annual operating plan to support those goals, consisting of eight 
msuor objectives and numerous subobjectives; 

• a designation of rsa officials responsible for implementing each of the 
eight m^uor objectives; and 

• a process for tracking and reporting results. 
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This conceptually sound process had the essential elements of a success- 
ful planning mechanism but was generally unsuccessful because of the 
lack of staff continuity to execute the plan. For example, during fiscal 
year 1988 rsa was under the leadership of three different commission- 
ers. In addition, the chief coordinator of rsa's planning activities was 
reassigned to another osers component, and his senior analyst was 
detailed to a different rsa office. 

According to a memorandum on ' .al year 1988 goals prepared by rsa's 
planning director in December 1£>. <,, 

". . . there were a number of instances where additional progress was hampered by 
the inability of the decision-making process to respond to questions proposed by the 
various work groups regarding directions, concerns and positions taken. In addition, 
the 'leadership' issue probably contributed to the lack of greater success in many of 
the developmental aspirations that were planned at the beginning of the year." 

The acting commissioner of rsa told us in March 1989 that rsa did not 
have a formal plan for fiscal year 1989 because rsa continued to work 
toward achieving the goals and objectives established in the 1988 plan. 

The Special Education planning process focused on its annual budget 
process for awarding discretionary grants. The former director of this 
component told us in February 1989 that planning for osep's discretion- 
ary grant programs was a 10-month process of setting and revising pri- 
orities for awarding such grants to state and local agencies, universities, 
and other organizations under 12 discretionary grant programs. 

Each year the Office of Special Education Programs prepares an internal 
planning document that describes the purpose, program strategy, and 
proposed new activities for each of the discretionary grant programs. In 
some cases, these grants appeared to be linked to the broadly stated 
goals of the former Assistant Secretary. For example, 1 of osep's 12 dis- 
cretionary grant programs awarded grants to improve the educational 
services provided to secondary school aged children with handicaps and 
to assist them in making the transition from school to work. 



OSEP Operational Planning 
Efforts 
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According to the same former Special Education director, the planning 
process also involved formula grants. During fiscal year 1988, osep 
aw^arded $1.7 billion to state education agencies under five formula 
grant programs. While formula grants accounted for over 90 percent of 
OSEP's budget, the former director told us this part of OSep's workload 
required little planning because the amount of the award was formula 
driven and monitoring was accomplished according to a 4-year cycle 
that needed little ac^justment. Therefore, the former director believed 
that a strategic plan with goals and objectives was unnecessary for 
formula grants. 

NIDRR Priority Planriiig Process mdhr s planning process concentrates un de\ eloping prioritieb for annu- 
ally awarding about $50 million in discretionary grants for research, 
demonstrations, and utilization projects in the rehabilitation field. 
Despite the lack of a formal plan, nidrr officials told us they set 
research priorities after receiving input from disabled persons through 
workshops, letters, and parent meetings and from nidrr's constituent 
groups. Similar to osep, no specific measurable component objectives 
were developed. 



Evaluating Component '^^^ ^^^^ ^ osERS-wide strategic planning system linking the objec- 
p X? tive; jf its components to the goals of the Assistant Secretary makes it 

difficult for component heads to track component progress. As a result, 
we were told by osers officials, progress is determined by component 
heads through (1) regularly scheduled meetings with key staff, (2) per- 
sonal involvement in component activities, and (3) tracking milestones 
established by components to see, for example, whether formula and 
discretionary grants are awarded by predetermined dates. 
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Figure 11 



GAO Management at 
Unit Level 



Majority of respondents said 
•Unit plans useful 

•Implementing unit objectives 
hindered by various factors 

•OSERS' operational practices 
hamper managemen : 



Management at Unit 
Level Within 
Components 



As shown in figure 11, most questionnaire rebpundent* at the organiza- 
tional unit level (divisions and branches within 0SE5JS components) said 
their units had operating plans that helped them to manage their indi- 
vidual programs and activities on a day-to-day basis. These operating 
plans included such elements as (1) goals and objectives for programs 
and activities, (2) tasks to be performed, and (3) time frames. However, 
many of these respondents cited hindrances in implementing their plans. 
For example, 81 percent of the rt^pondents statxjd that they believed 
that OSERS' operational practices, such as the Assistant Secretary's per- 
sonal involvement in the approval of travel, hampered their ability to 
properly manage their day-to-day activities. 
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Unit Plans Useful Almost 60 percent of the respondents stated that they had a written 

plan or document it described how their programs and activities were 
to be managed, and 79 percent of those with such a plan said it was at 
least moderately useful for managing unit activities. (See fig. 12.) 
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Figure 13 



GAO Factors Hinder implementation 
of Unit Plans 



• 74% cited insufficient staffing 

• 76% cited circumstances such 
as legislative and budgetary 
changes 

• 68% cited inadequate authority 
to make decisions 

• 58% cited inadequately trained 
staff 



Implementing Unit 
Objectives Hindered by 
Various Factors 



Of the respondents from units with written plans, 104 said they had 
some level of involvement in developing the plans, and 82 percent of 
these respondents were responsible for implementing a portion of their 
unit plans. Yet of the respondents who were directly involved and 
responsible for implementing their unit plans, many said they were hin- 
dered in their efforts by various factors, as shown in figure 13. 



ERLC 



Page 26 



28 



GA^ HRD.90.21BR Management of OSERS 



Department of Education: 
Management of the 
Office of Special Education 
and Rehabilitative Services 



GAO How OSERS Operational 
Practices Affect Management 

• Negative effects on component 
management cited by 

81 percent 

• Practices cited most frequently 
as problems: 

•Travel budgeting & approval 
•Personnel 



Operational Practices 
Hamper Performance 
Management 



On a related matter that affects a component's ability to effectively 
manage its operations, 149 of 183 respondents (81 percent) said osers' 
operational practices had hampered their component's ability to obtain 
necessary supportive services, such as travel and personnel. Of the neg- 
ative responses, 98 were classified as very negative. (See fig. 14.) 
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Figure 15 



GAO Human Resources Problems 
Cited by 75% of Respondents 

Major problems cited: 

•Components have difficuity 
filling vacancies 

•Many key positions filled on 
acting basis 

•Training and development 
programs limited 



In response to our inquiries about personnel matters that may affect 
their ability to achieve program goals and objectives, over three- 
quarters of the respondents indicated that staff vacancies, placement of 
statf in acting positions, and lack of adequate training courses were 
problem areas. (See fig. 15.) Similar concerns were expressed by state 
directors of special education and vocational rehabilitation, who said 
staff vacancies, staff in acting positions, and poorly trained osers staff 
were having a negative impact on their states' ability to achieve pro- 
gram goals. 



Human Resources 
Management 
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Figure 16 



GAO KeyOSERS Positions Vacant 
or hilled With Acting Personnel 

14 of 56 positions remained 
vacant or filled on acting 
basis as of February 1 989 

60 Number of PosUrons 




February 1988 February 1989 



Staff Vacancies and Aciing 
Managers Create 
Organizational Problems 



OSERS' practice of designating personnel to ser\ e m acting capacities for 
long periods of time generally created an environment in which impor- 
tant decisions on such matters as approval of state plans and levels of 
program funding were delayed. This situation also gave staff no incen- 
tive to engage in long-term planning or to start new program initiatives. 
Information we developed indicated that 21 of 56 key osers positions 
(component heads, division directors, regional commissioners, and 
branch managers) were vacant or being filled on an acting basis as of 
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Figure 17 



Effect of OSERS Vacancies/ 
Acting Officials at State Level 



Delays in serving eligible 
persons 

Lack of technical assistance 



Delays in monitoring activities 
Atmosphere of instability 



February 1988. At that tiipe, two regional rsa commissioner positions 
had been vacant for over a year. Information obtained from osers as of 
February 1989 indicated that some improvement had been made, but 14 
of these 56 positions were still vacant or filled with acting managers, as 
shown in figure 16. 

The majority of state directors for rehabilitative services (37) and state 
directors for special education (31) told us that having vacant manage- 
rial positions and staff functioning in an acting capacity in osers were 
having a significant effect on their programs at the state level. Some 
examples included states' inability to get technical assistance and advice 
on such programs as independent living, delays in OSEp's monitoring 
activities, and osers approval of state plans causing disruptions at the 
state level and generally creating an unstable atmosphere. (See fig. 17.) 
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Figure 18 



GAO Reasons Cited as Contributing 
to OSERS Staff Vacancies 



•Department and OSERS 
personnel procedures 

•Limited promotion potential 

•OSERS administrativ/e staff 
not helpful 



Eighty-four percent of the questionnaire respondents identified staff 
vacancies as a problem, and 55 percent said that their component could 
seldom fill critical vacancies when they occurred. As shown in figure 18, 
the reasons mentioned most frequently as contributing to this situation 
were: certain Department and osers procedures, such as no payment for 
relocation expenses of new employees; limited promotion potential of 
advertised positions; axid the uncooperative attitude of osers' adminis- 
trative staff responsible for filling vacant positions. It is important to 
note, however, that problems such as the limited promotion potential of 
certain positions could occur in any government department, agency, or 
office. 



Most respondents said the employee turnover rate for managers and 
senior staff was too high. They indicated that the turnover rate has 
decreased the number of qualified staff in their units, osers efficiency 



ERIC 



Page 31 



tJAO/HRI>.90-21BR Management of OSERS 

33 



Department of Education: 
Management of the 
Office of Special Education 
and Rehabilitative Services 



Figure 19 



GAO Training Programs Viewed 
Negatively by Respondents 



Reasons frequently cited: 

•Lack of clearly defined 
training program (148) 

•Lack of OSERS commitment 
(132) 

•Cuts in training funds (128) 

and effectiveness, and employee morale, osers maintained no data on 
turnover rates for its managers and senior staff. 



Training and development programs generally were viewed negatively. 
Fewer than one in six respondents believed that Department-sponsored 
internal training and development programs had been effective in 
improving their performance. The conditions cited most frequently by 
the respondents as detracting from the effectiveness of these programs 
are shown in figure 19. 



Ineffective Training and 
Development Programs 
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In discussions of this issue with oSERS component heads, division direc- 
tors, and branch chiefs, we were told that any osers employee who 
desires an individual training plan can have one prepared. However, the 
training courses available through the Department's He x^e Mann 
Learning Center in Washington, D,C,, include managerial and adminis- 
trative courses only. The center does not offer training in specialized 
subject matter related to special education or vocational rehabilitation 
issues, which employees say they want and need in order to keep cur- 
rent in their profession. 

Several division directors and branch chiefs told us that OAS would not 
approve travel to attend out-of-town seminars and conferences to obtain 
such specialized training because of budget restrictions. In addition, 
OSERS' regional staff could not attend courses at the Horace Mann Learn- 
ing Center because osers funds were not available to pay their travel 
costs or per diem expenses. 

Further, osERS officials told us that although rsa awards grants to states 
for staff development, their regional staff were unable to attend any of 
these programs or courses because of budget restrictions on travel. In 
effect, osERS mid-level managers stated that training and development 
opportunities for headquarters and OSERS regional staff were very 
limited. 



Grants Management 



OSERS' primary mission is to award and administer discretionary and 
formula grants to states and organizational entities that provide special 
education programs and vocational rehabilitation services to disabled 
persons. These activities comprise virtually all of OSERS' budget. Never- 
theless, questionnaire respondents with grant resporsibilities believed 
there are serious problems in evaluating and monitoring discretionary 
and formula grant performance due to limited staff and the unavailab?!- 
ity of travel funds. (See fig. 20.) 



Grant Procedures 



enerally Followed 



The Department has written procedures for managing grants and con- 
tracts. Sixty-nine percent of respondents with grant responsibilities indi- 
cated that their organizational units follow these written procedures for 
selecting field readers* to review proposals. Seventy-seven percent of 



'Persons selected by the Department to review grant applications from a roster of qualified and will- 
ing individuals. 
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Figure 20 



GAO Grants Management 



Survey responses by OSERS 
staff with grant management 
duties: 

• Grant award procedures 
generally followed 

• Evaluating and monitoring 
performance is a problem 

• Available travel funds limit 
monitoring activities 

respondents said that their organizational units follow appropriate 
procedures for awarding and administering grants and contracts. 



Evaluating and Monitoring Evaluating discretionarj- grantee performanct and monitoring formula 
Grant Performance Is a ^^^^ ^^^^ identified by osers senior staff and managers as serious 
Problem problem areas, osers managers believed the primary cause of the prob- 

lem was the limited staff and travel funds available to evaluate and 
monitor over 2,400 discretionary and formula grants. 
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Figure 21 



GAO Discretionary Grants 



Over 2,300 grantees awarded 
$338 millEon in FY 1988 

•Evaluating performance 
identified as serious problem 
by 49 percent 

*Few on-site assessments made 

•OSERS policy is generally to 
monitor by telephone 



Discretionary Grants During fiscal year 1988, ubEito awarded 2,366 dibcretiunar> grants total- 

ing $338 million, as noted in figure 21. Telephone discussions were the 
most coramon method used for monitoring grants, according to the for- 
mer OSEP director and 88 percent of 128 OSERS respondents. On-site visits 
were occasionally conducted. Information provided by osers officials 
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Figure 22 



GAO Discretionary Grant On-Site 
Visits Seldom Made 



Dollars Number Percent of 

in of On-Site Grantees 
Component Millions Grants Visits Visited 



RSA 


$118 


790 


78 


10 


OSEP 


169 


1367 


21 


2 


NIDRR 


51 


209 


10 


5 


Total 


$338 


2366 


109 


5 



indicated that on-site monitoring visits were conducted for about 5 per- 
cent of their discretionary grants during fiscal year 1988, as shown in 
figure 22. According to our questionnaire results, 26 of 80 respondents 
said that the frequency of discretionary grant on-site visits was 5 or 
more years. In addition, 21 respondents reported that some discretion- 
ary grants were never monitored on-site (see fig. 23). 
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Figure 23 





GAO Frequency Varies in IVlonitoring 
Discretionary Grantees 


Frequency 


Number of 
Respondents 


Every year 


6 


Every 2 years 


13 


Every 3 years 


6 


Every 4 years 


4 


Five years or more 


26 


Never 


21 


Other 


4 



Evaluating grant performance was identified by 58 of 119 respondents 
as a serious problem in the discretionary grant cycle. Many respondents 
said telephone monitoring was used in place of on-site visits because of 
OSERS* limited travel budget. The disadvantage to relying on telephone 
monitoring is the lack of on-site verification of grant ^e performance. 
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Figure 24 



GAO Formula Grants 



Grants account for 90% of 
OSERS' $3.7 biltion budget 

•Monitoring compliance a 
serious problem according 
to 57 percent 

•Travel funds and staff 
vacancies cited as cause 



Formula Grants About 90 percent of osers' ^3.7 billion fiscal year 1989 appropriation 

was devoted to formula grants. Of the 85 respondents with formula 
grant responsibility, 40 identified monitoring compliance as the most 
serious problem in the formula grant cycle. However, the problem 
seemed to be more prevalent in osep than in rsa. nidrr does not adminis- 
ter formula grants. Similar to discretionary grants, insufficient travel 
funds and staff vacancies were cited by many respondents as the pri- 
mary cause of this problem. (See fig. 24.) 
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Figure 25 



GAO Monitoring Formula Grants 

According to OSERS staff: 

• RSA generally monitors grants 
every year 



• OSEP grants are monitored 
4 or more years apart 



OSEP awarded $1.7 billion to state education agencies under five formula 
grant programs during fiscal year 1989. rsa awarded $1.4 billion in state 
formula grants to state vocational rehabilitation and blind agencies dur- 
ing the same period. The former OSEP director stated that Special Educa- 
tion's formula grants are monitored on-site according to a specific 
monitoring cycle. Thirty-three of 83 respondents indicated that their 
organizational unit's formula grants were generally monitored on-site 
every year. Thirty-two of these 33 responses came from rsa. (See 
fig. 25.) 
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Seventeen of 20 respondents reported that visits to osep formula grant 
recipients are 4 or more years apart. The former Special Education 
director told us that formula grant recipients are visited on a 4-year 
cycle. Information provided to us by osers officials showed that 13 of 51 
state education agencies were not visited on-site during fiscal vears 
1985 through 1988. 

Reports are prepared and issued to grantees after monitoring visits are 
completed, according to osers officials. It generally takes 90 days or less 
to prepare and issue monitoring reports, 50 of 74 respondents indicated. 
However, the time required to prepare and issue a monitoring report 
vaned significantly between osep and RSa and appeared unreasonable 
within OSEP. For example, 1 1 of the 14 osep respondents indicated that it 
took from 1 to 3 years to prepare and issue final monitoring reports. 

Information provided by osers officials indicated that 9 of 11 state spe- 
cial education agencies visited by osep during fiscal year 1987 had not 
received final monitoring reports as of February 1989 (see app. I). 
According to questionnaire respondents, the delays were attributed to 
slow departmental clearances and limited staff 

This information is generally consistent with that we received from our 
telephone survey of state special education directors. They said that not 
receiving formal monitoring feedback was one of their most critical 
problems in their relationship with osep. Their comments indicate that 
osep was not supportive of their states' need for responsive and timely 
feedback. Of th^ '^^l state directors, 22 said it sometimes takes 18 months 
or longer to re*. a final monitoring report from osep. For example: 

• California had a monitoring visit in September 1985, but did not receive 
its final report until April 1988. 

• Arizona was monitored in March 1984 and received a preliminary report 
in April 1988. As of February 1989, Arizona had not received its fmai 
report, but was revisited in June 1988. 

The Congress and state special education directors have been critical of 
OSEP's monitoring activities for the past several years. Recognizing that 
greater attention must h(\ "ovoted to improving its monitoring process, 
OSEP is collaborating with the Department's federal regional resource ' 
center, operated under contract to the University of Kentucky Research 
Foundation, to recommend improvements in the monitoring process. 
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Figure 26 



GAO Relationships With State 
Agencies Strained 

• Special education directors 
critical of program monitoring 
(21 of 51 ) 

• Vocational rehabilitation 
directors critical of program 
direction and policy guidance 
(33 of 51) 

• Both groups considered 
technical assistance limited 
(60 of 98) 



State directors of special education and vocational rehabilitation agen- 
cies identified several problems regarding t leir states' relationship with 
USERS. Program monitoring by osep was t!ie primary activity that troub- 
led most special education directors. Many said that their state formula 
grants had not been evaluated in 2 or more years and that it generally 
took about 18 months to receive a final monitoring report. Most state 
vocational rehabilitation directors' comments regarding osers manage- 
ment were negative. They were critical of osers program direction, pol- 
icy guidance, and particularly ssa's technical assistance. (See Tig. 26.) 



Federal/State 
Relationships 
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Figure 27 



GAo How Well Has OAS Established 


Program Goals and Objectives? 




Number of 


Number of 




Special 


Vocational 




Education 


Rehabilitation 




State Directors 


State Directors 


Very well 


9 


2 


Well 


24 


6 


Neither well 






nor poorly 


10 


11 


Poorly 


6 


18 


Very poorly 


1 


15 


No basis to judge 


1 


0 


Totai number of 






respondents 


51 


51 



Program Direction and 
Policy Guidance 



state officials had mixed views regarding the establishment of osers 
goals The majority of state special education directors (33 of 51) were 
pleased with the goals established by the former Assistant Secretary for 
persons with handicapping conditions. However, the same number of 
state vocational rehabilitation directors told us that oas had done a poor 
job of establishing national goals and objectives for handicapped per- 
sons. (See fig. 27.) According to many vocational rehabilitation 
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directors, their expertise and comments had been disregarded in set- 
ting goals for RSA. In addition, 80 percent of the state vocational 
rehabilitation directors stated that the partnership between their 
state agencies and RSA headquarters officials had deteriorated or 
ceased to exist, rsa regional offices, on the other hand, generally 
were viewed favorably by state vocational rehabilitation directors. 

Written federal policy guidance provided to the states by osep and RSA 
was generally chexacterized as moderately useful but untimely. Of 51 
state special education directors, 33 told us that the written policy guid- 
ance received from osep was untimely. Similarly, 43 of 51 state voca- 
tional rehabilitation directors said RSa's policy guida^ice was untimely. 
rsa's policy manual, for example, has gone without a major revision for 
14 years. In addition, OAS made policy decisions without obtaining 
needed input from state agencies, in the opinion of many state directors. 
While considered moderately useful, written policy guidance from osep 
and RSA also was specifically characterized by many state directors as 
sporadic, incidental, and outdated. Several state directors said that this 
caused, among other things, problems in trying to determine who was 
eligible to receive services. 



Both state vocational rehabilitation and state special education directors 
were critical of OSERS technical assistance efforts. Many state vocational 
rehabilitation directors said the on-site technical assistance provided by 
RSA was very limited. For example: 

Sixty-three percent said RSA staff generally were unaware of the kinds 
of rehabilitation services needed in their state. 
Forty-five percent believed that this lack of expertise results from p.sa 
staff being inexperienced and improperly trained. 
Fifty-five percent believed the RSA staffs lack of expertise has had a 
negative effect on their ability to achieve their state program goals 
because they frequently cannot get program guidance and needed tech- 
nical assistance. 

As shown in figure 28, many state vocational rehabilitation directors 
also said that on-site technical assistance provided by RSA staff was 
ineffective. Although requests for technical assistance continued to be 
made, gas frequently denied on-site technical assistance. Several state 
vocational rehabilitation directors said that RSA regional office staff 
were not allowed to travel for the purpose of providing technical 
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Figure 28 



GAO RSA Technical Assistance 



Ineffective, according to many vocational 
rel^abSiitation directors 



Level of Number of 

Effectiveness Rejsnonripnt. 



Very effective 


3 


Effective 


10 


Neither effective nor ineffective 


12 


Not effective 


23 


Do not know 


1 


No basis to judge 


2 



assistance to the state agencies, even when states offered to pay for 
travel expenses. As a result, some states believed that osers has a 
policy against providing technical assistance to states. Within the 3- 
year period 1986-88, 32 vocational rehabilitation directors told us 
that OAS had denied on-site technical assistance. In addition, another 
10 state directors told us they did not even bother to request such 
assistance because they knew it would be denied. 

In commenting on the quality of osep staff, 57 j?ercent of the 51 state 
special education directors indicated that osep .staff generally was not 
knowledgeable about the special education program needs in their state. 
In addition, 80 percent of the directors said that their states had not 
received any on-site technical assistance from osep over the last 3 years. 
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Figure 29 



GAO Overall Perceptions On 
OSERS Management 



• OAS' management approach 
negatively influenced unit 
m.anagement 

• Problems identified by 
managers and senior staff 

• Relationships with state 
agencies strained 



The former Special Education director told us his travel budget was not 
used for technical assistance visits because such trips were supposed to 
be performed by staff from the Department's Regional Resource Cen- 
ters. It was OSERS policy for headquarters personnel to limit their techni- 
cal assistance to sending copies of pertinent information to state 
officials. 



Over three-quarters of OSERS managers and senior staff believed that the 
overall management approach within Osers had a negative effect on the 
day-to-day operations of their organizational units. A primary reason 
for these negative feelings was the perceived excessive involvement of 
OAS in component activities. These feelings were expressed in question- 
naires completed by subslantial numbers of managers and senior staff in 
all three OSERS components. (See fig. 29.) 



Overall Perceptions on 
OSERS Management 
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Figure 30 



GAO Effect of OAS' Management 
Approach on Unit Operations 



Most reported negative effect 




7% 

Don't know 

5% 

Positive 



9% 

No effect 



Negative 



Overall Management 
Approach 



Accordins to 79 percent of osers managers and senior staff responding 
to our quest' ^nnaire, the former Assistant Secretary 't, overall manage- 
ment approach negatively influenced the management of their organiza- 
tional units. (See fig. 30.) Over half of these officials indicated that the 
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former Assistant Secretary's overall management approach had a very 
negative effect on their unit operations. Specific explanations cited by 
respondents included (1) too much intervention and micromanagement 
in component activities, (2) lack of professional respect toward the 
staff, and (3) failure lo support RSa goals. Nine of 184 respondents 
(5 percent) indicated that the former Assistant Secretary's overall 
management approach had a positive effect on their units' daily 
management. 



Problems Identified by 
OSERS Managers and 
Senior Staff 



One hundred and sixty OSERS managers and senior staff identified one or 
two problems that adversely affected their units. In the responses we 
reviewed, poor management practices and what they often referred to 
as "micromanagement" were mentioned most frequently. The most com- 
mon practice cited as poor management was the filling of top manage- 
ment positions with "acting managers" or allowing positions to remain 
vacant for extended periods. 

Restrictions on travel were often cited by respond ^ regarding 
micromanagement. Similar findings also were identified by the Depart- 
ment's Management Improvement Service (mis). In its October 1987 
report, MIS discussed travel limitations on RSA regional offices, mis 
reported that one of the greatest irritants to both regional commission- 
ers and regional staff was the lack of travel funds that would enable 
them to provide more comprehensive monitoring and assistance ro 
grantees, mis made several recommendations to OSErs management, 
including one that OAS allocate a travel budget to each RSA regional com- 
missioner to independently manage employee travel within the region's 
prescribed budget. While OSERS provided no formal response to the mis 
report, OAS proposed a revision to its travel policy with respect to rsa's 
regional offices in a February 9, 1989, memorandum. The proposal 
would authorize the regional commissioner rather than OAS to approve 
all travel orders and vouchers fc. subordinate staff. As of August 1, 
1989, no final action had been taken on this proposal. 
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Figure 31 



GAO Problems That Need Solving 



Problems mentioned most 
frequently by OSERS managers 
and senior staff 

•Micromanagement and over- 
control of component heads 
by OAS 

•Selection of competent 
management staff 



The two most frequent areas requiring os^.&' top management attention, 
accordinj^ to questionnaire respondents, were micromanagement and 
staff competencies. (See fig. 31.) Respondents' conunents were consis- 
tent with information we obtained throughout the questioruiaire. Most 
respondents generally agreed that qas was too involved in component 
activities, such as setting policies, allocating resources, prog.ram man- 
agement, and particularly administrative operations. Other problems 
receiving frequent mention were the former Assistant Secretary's per- 
ceived lack of respect for staff and infrequent recognition of employees' 
abilities, poor leadership, ineffective organizational structure, and a 
need for better communication and cooperation between oas and the 
three users components. 



ERIC 



Page 48 



50 



GAO/HRD.90-21BR Management of OSERS 



Department of Education: 
Management of the 
Office of Special Education 
and Rehabilitative Services 



A rt r" rr> /zkrsfc We received written comments on our report from the Department of 

Agency L;OinmenLS Educations new Assistant Secretary- for Special Education and Rehabili- 

tative Services. The Department generally agreed with our findings and 
said it was planning actions to address the management concerns identi- 
fied. The Assistant Secretary said his new management team considers 
returning sound management practices and impro^ >d morale to OSErs as 
one of its highest priorities. The Department's September 5, 1989, letter 
is presented in appendix VI. 
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OSEP's Formula Grant Monitoring Visits 
to the 50 States and District of Columbia 
(Fiscal Years 1985-88) 



State 


Year nn^l^A 

visit conducted 


Tear iinai 
report issued 


Year corrective 
action Dfan received 

M w %l w 1 1 M 1 %m III WWW 1 V WU 


Alabama 


1987 


Not issued 




Alaska 


1987 


Not issued 




Arizona 


1988 


Not issued 




Arkansas 


1986 


1987 


1988 


California 


1985 


1988 


1S88 


Colorado 


1987 


Not issued 




Connecticut 


- 






Delaware 








District of Columbia 


1988 


Not issued 




Florida 


1987 


1988 




Georgia 


1986 


1988 


1988 


Hawaii 


1985 


1987 


1987 


Idaho 


- 






Illinois ^ 


- 




— 


Indiana 


1986 


1988 


1988 


Iowa 


1988 


Not issued 




Kansas 


1986 


1988 


1988 


Kentucky 


1985 


1937 


1987 


Louisiana 


1985 


1987 


1987 


Maine 


1987 


Not issued 




Maryland 


1986 


Not issued 




Massachusetts 


1986 


1987 


1988 


Michigan 


1988 


Not issued 




Minnesota 


1985 


1987 


1987 


Mississippi 


1987 


Net issued 




Missouri 


1988 


Not issue-l 




Montana 








Nebraska 


1987 


Not issued 




Nevada 


1986 


1988 


1988 


New Hampshire 








New Jersey 


1987 


Not issued 




New Mexico 


1988 


Not issued 




New York 








North Carolina . . 1 


North Dakota 








Ohio 


1986 


1987 


1988 


Oklahoma 


1986 


1987 


1988 


Oregon 


1987 


1988 




Pennsylvania 


1988 


Not issued 





(continued) 
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OSEP's Fomula Grant Monitoring Visits to 
the 50 Sutes and District of Columbia 
(Fiscal Years 1985^) 



State 


/ear onsite 
visit conducted 


Year final 
report issued 


Year corrective 
action plan received 


Rhode Island 


1986 


1987 


1988 


South Carolina 


1986 


1987 


1987 


South Dakota 








Tennessee 


1987 


Not issued 




Texas 


1986 


1983 


1988 


Utah 


Vermont 


1987 


Not issued 




Virqinia 


Washington 


1988 


1988 




West Virginia 


1986 


Not issued 


1988 


Wisconsin 


1988 


Not issued 




Wyoming 
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Note: Questions 1 through 3 are excluded from this sur .nary. These 
questions asked for information on the rv,spondents* (1) length of service 
workmg for osers; (2) pay plan, job series, and grade level; and (3) 
length of time in current position. 



I. Background 



4. For the purpose of this study we have identified four levels of 
managemen^^ to which we refer in this questionnaire. Respondents 
were asked to cite the level of management that best describes 
their position; (187 responded.) 




22 



59 



102 



!!c,c[;.n.''c "raiager-the person between the second levelmanager and the 
Sofal^ngai^e^"'^^"'^'^"' component Lads? 



Second level manager— the persor> having direct responsibility 'or soedfic 
?o^™Tl- ^ °' admiriistratiye units, (e.g.. Deputy. Associate and RegS 
Commissioners; Division D-ffectors: and directors of administrative Xes) 

cpn/nl7o!L?^"^3°'~''^?.uP^'^°" reporting Jo a second level manager or a 
fnH/nr'oH^' "'^'}^^^'- ^ay today responsibility for a particular programfsi 
rhi^?. .^''hTJ'' ''''rJ""?i'°''' 3" organizational unit. (e.g.. Branch ^ ' 
Chiefs and senior staff with supervisory responsibilities) ^ 



£!5luDS>^'nfS1!i'°""^' (Respp-idents who identified thiir position as 
nonsupervisory personnel were asked to go to question 8.) 



II. Gv;neral 
Management 



Policies, Goals, and 
Objectives 



For the purpose of this section, policy is defined as a decision or set of 
decisions which provide direction and/or guidance for an organization. 
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5. To what extent are policies which affect your programs and activ- 
ities mitiated by each of the f oUowing entities? (107 responded-) 




Very great 
extent 


Great 
extent 


Moderate 
extent 


Some 
extent 


Little or Don't 
no extent know 


Congress 


47 


29 


11 


9 


7 1 


White House 


5 


4 


14 


15 


44 17 


Secretary of Education 


6 


8 


16 


25 


34 12 


Under Secretary or Deputy Under Secretary for Management 


5 


10 


17 


26 


28 14 


Assistant Secretary for Special Education and Rehabilitative 
Services 


45 


34 


14 


9 


4 0 


Senior-level managers 


21 


25 


31 


16 


8 2 


Second level managers 


11 


13 


25 


27 


19 3 


Regional offices 


7 


10 


9 


19 


42 7 


Other federal organizations (i e . 0MB. 0PM, GSA) 


13 


15 


31 


18 


17 8 


Advocacy and interest groups 


7 


19 


15 


40 


15 5 


Other 


1 


4 


3 


2 


0 2 



6. Generally, how are the Assistant Secretary for Special Education 
and Rehabilitative Services' goals and objectives concerning special 
education and rehabilitative services communicated to you? (105 
respondents cited one or more method.) 



Number 


Formal or informal meetings with the Assistant Secretary 


16 


Formal or informal meetings with the senior-level manager 


48 


Memorandum from the Assistant Secretary 


45 


Memorandum from the senior-level r anager 


62 


Other 


30 
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7. On a recurring basis, the Assistant Secretary for Special Educa- 
tion and Rehabilitative Services makes decisions on both osers poU- 
cies and operations. GeneraUy, in making these decisions, how 
effecuvely does the Assistant Secretary use the activities listed 
below? (106 responded.) 


Activity 

Involve appropriate staff 
Consider alternatives 


Very we!! 

3 
2 


ii» II A_. A . No basis 
Well Adequately Poorly Very poorly to judge 

7 2: 36 26 
4 6 23 M 


Consider long-term effects of decisions 

Make decisions in a timely manner 

Coordinate with OSERS components 
during policy formulation process 


4 
4 

3 


4 
3 

6 


4 22 35 34 
10 32 34 22 

4 25 32 35 



8. What is your role iii the development of goals and objectives for 
your unit? (185 respondents cited one or more role.) 





Role 


Number 


Not involved 


37 


Develop and submit the proposed goals and objectives to the second level 




manager 


74 


Participate With the second level manager in he development of proposed 
goals and objectives submitted to the senior-level manager 


69 


^ manager^ submit the prooosed goals and objectives to the senior-level 






47 


Participate with the senior-level manager In the development of proposed 
goals and objectives submitted to the Assistant Secretary 


41 


Participate in the development of the Assistant Secretary's proposed aoals 
and objectives submitted to the Under Secretary or Secretary 


4 


Participate in discussions with the Assistant Secretary 


11 


Participate in discussions with the Secretary 


1 


Other — 


28 
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9. Is your individual performance assessed against your unit's (or 
component's) goals and objectives? (184 responded.) 





Number 








97 


No 






58 



Don't know 



10. Does your appraisal system provide rewards and incentives for 
meeting your unit's (or component's) goals aiid objectives? (185 
responded.) 




11. Are you held accoimtable throu.<h your individual performance 
appraisal system for meeting your unit's (or component's) goals 
and objectives? (184 responded.) 




Don't know 
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12. Lir 3d be'ow are conditions that may impact on the ability to 
develop or formulate goals and objectives to implement policies 
affecting your program and activities. (Respondents were asked if 
the following conditions exist in ti.»..a- component and the extent 
the condition impacted on the ability to develop or formulate poK- 
cies concerning their program and activities. 180 responded.) 




Condition 


Does it exist? 
No Yes 


Very great 
extent 


Great 
extent 


{Moderate 
extent 


Some 
extent 


L/ttle or 
no extent 


Don't 
know 


Unrealistic or unclear policies 


30 


148 


41 


55 


28 


20 


3 


1 


Lack of adequate guidance from OAS 


46 


125 


44 


45 


20 


8 


2 


4 


Lack of adequate guidance from your 
organizational unit 


56 


114 


31 


C4 


22 


21 


5 


0 


Lack of conr]nr]itment from the Assistant 
Secretary 


60 


101 


41 


41 


11 


4 


3 


1 


Department clearance untimely (e.q., OGC 
OPBE) ^ 


23 


152 


62 


52 


22 


11 


1 


1 


Lack of adequately trained staff 


43 


131 


40 


42 


31 


12 


0 


1 


Poor communication among components 


27 


151 


55 


36 


36 


17 


3 


2 


Poor communication among units 


31 


144 


48 


37 


33 


22 


1 


1 


Major changes Initiated too often 


73 


95 


42 


26 


14 


9 


2 


1 
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13. Your opinions about iJolicy making affecting OSERS* components 
may reflect both positive and negative experiences. Please describe 
below a specific policy decision where you believe the decision-mak- 
ing process was less than adequate. 

120 respondents identified what the decision was, where the process 
broke down, and the effects of the problem on their operations. 



Planning Which of the following documents or processes are the principal 

sources of guidance for planning the activities for which you are 
responsible? (185 respondents cited one or more document.) 





Document 


Number 


The Department's budget 


77 


Legislative requirements 


132 


Regulatory requirements 


134 


Special projects or initiatives 


99 


Work group/task force initiatives 


72 


Component operating plan (goals and objectives) 


91 



Other 42 



15. Good management practices generally require that organiza- 
tions establish long range program goals and objectives. Are you 
aware of any comprehensive 0SER5-wide effort led or coordinated by 
the Office of the Assistant Secretary to develop such specific goals 
and objectives? (Respondents were asked to exclude plans that 
focus on a single area, such as information resources management, 
evaluation, or specific implementation plans.) (186 responded.) 







Number 


Yes 






38 


No 






120 


Not sure 






28 
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16. Do you have a written plan or document(s) which describes how 
you manage your program and activities? (185 responded. Respon- 
dents answering "no" were asked to go to question 25; respondents 
answering "does not -^pply" were asked to go to question 26.) 




17. Which of the following elements ave included in your plan(s)? 
(109 respondents having written plans cited one or more element.) 



Element 


Number 


Goals and objectives for programs/activities 


92 


Tasks to be performed 


99 


Time frames 


100 


Responsible officials 


69 


Priorities 


74 


Alternative tasks 


11 


Organizational performance measures (i.e., output efficiency measures) 


39 


Other 


9 



18. What is your personal role in developing this plan(s)? (109 
respoiidents cited one or more role.) 



Role 


Number 


Not involved 


5 


Participate with second level manager in development of proposed plan 
submitted to the senior-level manager 


60 


Participate v;ith the senior-level manager in the development of the proposed 
plan submitted to the Assistant Secretary 


28 


Participate in the development of the Assistant Secr^^'^rv's proposed plan 


4 


Develop and submit the unit's proposed plan to the ' J level manager 


28 


Develop and submit the unit's proposed plan to the t ^r-level i^anager 


18 



Other 15 
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19. Of how much use i^. this written document(s) for managing your 
unit's activities? (109 responded.) 





Number 


Very great use 


15 


Great use 


22 


Moderate use 


49 


Some use 


17 


Little or no use 


6 



20. Are you directly invoP ad and responsible for implementing 
your unit's plan: (108 responded. If respondents ans;vered "no," 
they were directed to question 26.) 




21. Listed below are conditions that may have an impact on your 
ability to implement your unit's plan. (Respondents with written 
plans wer asked if the following conditions exist in their compo- 
nent and the extent the condition impacted on their plan. 86 
responded.) 




If yes, the extent of Impact ? 



Condition 


Does it exi'^t? 
No Yes 


Very great 
extent 


Great 
extent 


Moderate 
extent 


Some 
extent 


Little or 
no extent 


Don't 
knov/ 


Lack of realistic goals, 
objectives, and priorities 


35 


43 


11 


14 


11 


7 


0 


0 


Lack of adequately trained staff 


34 


47 


15 


16 


9 


6 


f 


0 


Not enough staff 


22 


64 


29 


17 


13 


4 


1 


0 


Lack of adequate authority 


27 


57 


21 


24 


7 


5 


0 


0 


Lack of commitment by 
senior managers 


39 


45 


19 


15 


8 


1 


1 


1 


Circumstances change (i e., legislative changes, 
budget Increase/ decrease, etc.) 


19 


60 


18 


23 


10 


8 


1 


0 


Other 


5 


27 


19 


6 


1 


0 


0 


0 
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22. How do you monitor iinplementation of your plan to ensure that 
your policies, goals, and objectives are being achieved? (89 respon- 
dents cited one or more methods. Respondents who cited "not 
responsible for monitoring" were directed to question 26.) 




Number 



Not responsible for monitoring io 

Meeting with key staff people 57 

Written progress reports 44 

Management-by-exception principle (i.e. involvement when problei is are 

indicated) 24 

Pers onal involvement in your organization's op erations on regular basis 51 

Use of performance measures (i.e. timeliness, quality, productiv ity, etc.) 49 

Other 12 



23. If you are responsible for monitoring implementation of your 
plan, where are the monitoring results forwarded? (76 respondents 
cited one or more.) 



Number 


Results not forwarded 




5 


Supervisor 




51 


Component head 




31 


Office of the Assistant Secretary 




9 


Other 




12 



24. Are these monitoring results provided orally or in writing? (70 
responded.) 



Number 


Orally 


4 


!n writing 


15 


Both orally and in writing 


51 
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25* If you do not have a vmtten management plan, what methods do 
you use to help manage your program and activities? 

48 respondents provided methods ' used to help manage their pro- 
grams and activities. 



Program Direction y^^^ opinion, does the Office of the Assistant Secretary (gas) 

set broad program priorities for each component? (182 responded^ 
Respondents who answered "no" were directed to questicii 280 





Number 


Yes 


114 


No 


64 


Don't know 


4 



27. One function of the Office of the Assistant Secretary (OAS) is to 
establish broad program priorities for the components and oversee 
their implementation. In your view, how well does the Office of the 
Assistant Secretary do each of the following? (121 responded.) 







Activity 


Very well 


Well 


Adequately 


Poorly 


Very poorly 


No basis 
to judge 


Communicate the Assistant Secretary's 
program priorities to RS^ NIDRR. and OSCP 


14 


7 


24 


36 


25 


15 


Establish realistic OSERS-wide objectives 


4 


7 


16 


37 


39 


16 


Track RSA, NIDRR, and OSEP's implementation 
of the Assistant Secretary's priorities 


8 


10 


17 


34 


16 


35 


Coordinate activities requiring co^ aration 
between OAS and the components 


2 


6 


9 


40 


35 


28 


Respond to major concerns surfaced by senior- 
level managers, the regional offices, a d 
constituents 


4 


3 


9 


27 


51 


27 
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28. OSERS has a unique organizational structure in that the Assistant 
Secretary as well as two of the three component heads reporting to 
her (rsa's commissioner and nidrr's director) are appointed by the 
President. To what extent do you believe the overall osers' organi- 
zational structure positively or negatively affects the decision mak- 
ing process of your component? (181 responded.) 





Number 


Very positive 


5 


Positive 


2 


Neither positive nor negative 


35 


Negative 


56 


Very negative 


50 



No basis to judge 33 



29. To what extent do you believe the osers' operational practices 
positively or negatively affect your component's ability to get nec- 
essary supportive services (e.g., personnel, travel, equipment)? 
(183 responded.) 



I!umber 


Very positive 


2 


Positive 


1 


Neither positive nor negative 


lb 


Negative 


51 


Very negative 


98 


No basis to judge 


16 



30. In your opinion, how well or poorly does your component carry 
out its overall statutory requirements? (i.e., fulfilling congressional 
mandates) (185 responded.) 



Number 


Very well 


37 


Well 


70 


Neither well nor poorly 


32 


Poorly 


34 


Very poorly 


10 


Don't know 


2 
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31, We realize that you may have had both positive and negative 
experiences within osers. However, for purposes of this review, we 
are ii terested in identifying management areas needing improve- 
ment* Please describe a specific instance where you believe your 
component carried out its statutory requirements less than ade- 
quately, (If respondents couM identify a management area needing 
improvement, they were asked to specify its effect on their compo- 
nent's operation.) 

121 described a specific instance where they believed that their compo- 
nent carried out its statutory requirements less than adequately. 

32. Based on your osers experience a' .d in your opinion, how appro- 
priate is the degree of involvement by the Office of the Assistant 
Secretary (OAS) for each of the following functions, within your 
component? (184 responded.) 





Function 


Too much 
involvement 
by OAS 


Appropriate 
involvement 
by OAS 


Too little 
involvement 
by OAS 


No basis 
to judge 


Program planning 


76 


22 


23 


55 


Policy setting 


92 


27 


18 


39 


Resource allocation 


119 


20 


10 


31 


Program management 


101 


23 


19 


36 


Program evaluation 


56 


21 


38 


59 


Administrative operations: 


114 


14 


12 


22 


Hiring practices 


117 


21 


8 


33 


Travel approvals 


149 


11 


3 


20 


Other 


23 




2 


7 



33. One management function within OSErs is to provide interpreta- 
tions of legislation, regulations, policy memorandums, directives, 
etc. Is responding to questions or providing interpretations on this 
general guidance material raised by states and grantees important 
to fulfilling your assigned duties and responsibilities? (184 
responded*) 





Number 


Yes 




14/< 


No 




40 
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34. To what extent '^o you agree or disagree with each of the follow- 
ing statements concerning the existing quality of written policy 
guidance which your component provides to states and grantees? 
(Of the 144 who ansvt^ered "yes" in question 33, 136 responded to 
this question.) 







Strongly 
agree 


Agree 


Neither 
agree nor 
disagree 


Disagree 


Strongly 
disagree 


Unclear 


29 


37 


2b 


30 


6 


Too detailed 


2 


8 


38 


57 


16 


Not detailed enough 


13 


40 


40 


17 


6 


Too technical 


2 


7 


47 


50 


11 


Outdated 


33 


31 


22 


28 


8 


Other 


30 


7 


1 


2 


0 



Financial Data quality of financial data (i.e., budget data; cost accounting 

which provides unit, program, or organizational costs; grant or con- 
tract management; etc.) creates management problems for you, 
briefly describe the problem, the effects it has on your operations, 
and identify the financial system or report from which the financial 
data is obtained* 

72 provided narrative respoidjes. 
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IIL Personnel 



36. Listed below are personnel conditions that may affect yo«ir abil- 
ity to achieve program goals and objectives. Respondents were 
asked if the following conditions exist in their component and if so, 
the extent the condition affected achieving program goals and 
objectives. (180 responded.) 



If yes, the extent of effect? 



Condition 


Does it exist? 
No Yes 


Very great 
extent 


Great 
extent 


Moderate 
extent 


Some 
extent 


Littror 
no extant 


Don't 
Know 


Staff vacancies 


28 


152 


64 


51 


24 


6 


4 


0 


Staff in "acting" positions 


37 


143 


55 


38 


22 


12 


10 


4 


Lack of adequate training 


39 


136 


49 


33 


36 


10 


3 


2 


Inadequate performance appraisal system 


66 


108 


34 


27 


26 


10 


4 


5 


Lack of discipline 


102 


68 


13 


19 


19 


8 


6 


1 


Inadequate experience or knowledge of staff 


75 


97 


27 


33 


22 


10 


3 


0 


Otiier 


4 


37 


24 


10 


1 


0 


0 


0 



37. If a position you know to be critical to the success of your orga- 
nizational unit becomes vacant, can your component fill it with a 
qualified individual in a time frame that m<"ets the unit's require- 
ments? (182 respoiided. The respondents who cited "not applicable 
to my position'' or "almost always" were directed to question 39.) 





Number 


Not applicable to my position 


29 


Almoot always 


11 


Sometimes 


42 


Seldom/never 


100 
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38. To what extent do you attribute the difficulty in filling a 
vacancy to each of the following factors? (143 responded.) 



m 



Factor 


Very great 
extent 


Great 
extent 


Moderate 
extent 


Some 
extent 


1 ittip nr 

no extent 


know 


Poor recruitment effort 


14 


26 


29 


22 


35 


9 


Limited pool of applicants 


10 


u^ 


18 


19 


5? 


15 


Low starting pay 


13 


21 


25 


22 


41 


13 


Ciassification standards 


16 


16 


17 


21 


43 


22 


Poor image of federal government 


32 


18 


21 


22 


28 


18 


Competition from other federal or private employers 


12 


19 


24 


16 


46 


19 


Civil Service rules and procedures 


14 


18 


25 


22 


43 


16 


Department procedures 


36 


27 


19 


20 


16 


-.8 


OSERS procedures 


59 


32 


16 


7 


9 


14 


OSERS personnel/administrative staff not helpful 


40 


26 


1h 


8 


19 


29 


OSERS personnel/administrative staff not quaiifiec 


24 


19 


11 


9 


24 


48 


Limited promotion potential 


37 


28 


21 


18 


20 


11 


Budget constraints 


36 


22 


18 


17 


18 


21 


Lack of delegated authonty from component head or regional 
comn'ssioner 


41 


17 


8 


9 


30 


30 



39. Many current and former top-level managers in government 
believe that ^aistit\itional memory is important for continuity and 
perspective. Other e streso the advantages >f bringing in v^w people 
with fresh porspoctives, In your view, is the turnover rate in your 
component— i.e. the rate at which managers and senior staff enter 
and leave (NffiRR, OSEP, or RSa)— too high, too low, or about right? 
(168 respond'^d. If respondents did not cite "too h^gh" for either 
managers or senior staff, they were directed to question 41.) 




Manager and senior staff turnover rate Is: 

Don't know Too low About right Too high 

Managers ~ 18 Tg 31 "Tl 



Senior staff 20 16 34 
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40. A high turnover rate could have changed certain characteristics 
of your unit. Please indicate if high turnover has increased or 
decreased the occurrence of each characteristic listed below. (113 
responded.) 





Characteristic 


Increased 
greatly 


Increased 
somewhat 


Remained 
the same 


Decreased 
somewhat 


Decreased 
greatly 


Number of qualified 
staff in your unit 


5 


8 


28 


39 


31 


Number of unqualified 
staff in your unit 


13 


26 


56 


8 


1 


Efficiency and 
effective- 
ness of your unit 


7 


6 


18 


50 


31 


Employee morale in 
your unit 


8 


2 


7 


28 


68 


Other 


7 


1 


0 


2 


8 



Training and Development '^^ ^^^^ extent do you believe Department of Education- 

^ sponsored internal training and development programs have been 

effective or ineffective in improving your performance? (183 
responded.) 







Number 


Very effective 


3 


Effective 


25 


Neither effective or ineffective 


46 


Ineffective 


23 


Very ineffective 


59 


DoiVt know 


18 


None or little offered 


10 



ERIC 



Page 67 



GAO/HRD-OO-aiBR Management of OSERS 



Appendix EE 

Summary of GAO Questionnaire Respon^'es 



42. Listed below are conditions that may influence the effective- 
ness of Department-sponsored internal training and development 
progi-ams. (Respondents were asked if the foUowing conditions 
exist in their component and, if so, the extent the condition 
detracted from the effectiveness of their internal training and 
development programs. 172 responded.) 











If ves. the extent it detracts 






Condition 


Does It exist? 
No Yes 


Very great 
extent 


Great 
extent 


Moderate 
extent 


Some Little or 
extent no extent 


Don't 
know 


Lack of a clearly 
defined training 
program 


24 


148 


54 


45 


25 


21 


2 


1 


Limited .staff time 
allowed for training 


55 


112 


39 


37 


19 


13 


1 


1 


Lack ofOSERS 
commitment to 
develop and 
support 3taff 
training 


31 


132 


63 


40 


18 


7 


0 


2 


Courses do not meet 
employee needs 


55 


100 


24 


25 


27 


18 


2 


2 


Courses do not meet 
program '•-eds 


45 


107 


30 


29 


24 


18 


3 


1 


Lack of personnel 
office assistance 


65 


82 


31 


13 


16 


11 


1 


5 


Training staff not 
qualified 


95 


37 


10 


4 


8 


5 


3 


6 


Cuts in training funds 


25 


128 


75 


24 


16 


4 


1 


o 


Otner 


0 


?2 


15 


6 


1 


0 


0 


0 



ERIC 



Pag*; 68 



GAO/HIID-90-21BR Management of 0S2RS 



Appendix n 

Summary of GAG Questioniuurc Responses 



IV. Grants and 
Contracts 



Discretionary Grants and 
G>ntFacts 



43. Are the awarding and/or administration of discretionary grants 
or contracts an essential part of or important to fulfilling your job- 
related duties? (186 responded.) If respondents answered "no" to 
both, the- were directed to question 58.) 





msB^mrnmnirnKwaaa^m^ ii iii iiiib 


Yes 


No 


Contracts 


60 


99 


Discretionary grants 


119 


62 



44. Within the award process, the Department of Education has 
written procedures for (1) selecting field readers for reviewing pro- 
posals; and (2) awarding and administering discretionary grants 
a ..i/or contracts. In your opinion, to what extent does your organi- 
zational unit adhere to these procedures? (128 responded.) 





Procedures 


Very great 
extent 


Great 
extent 


Moderate 
extent 


Some 
extent 


Little or 
no extent 


Don't 
know 


Selecting 
field 
readers 


51 


37 


21 


8 


5 


5 


Awarding & 
administering 
graiits/ 
contract > 


55 


44 


15 


6 


2 


6 
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45. In your opinion, how often are field readers added to the review 
panel after the component's list of qualified readers is forwarded 
to OAS for review and approval? (122 responded. If respondents 
cited "neither often nor seldom," "seldom," "very seldom," or 
"never," they were directed to question 48.) 





Number 


Very often 


19 


Often 


24 


Neili»w;r oUen nor seldom 


23 


Seldom 


17 


Very seldom 


19 


Never 


14 


Don't know 


6 



46. In your opinion, now often axe these additions to the review 
panel Ust justified in writing by the Office of the Assistant Secre- 
tary? (46 responded. Only respondents indicating "very often" ^r 
"often" in question 45 were directed to answer question 46 and 
question 47.) 



Number 


very often 


2 


Often 


3 


Neither often nor seldom 


1 


Seldom 


4 


Very seldom 


6 


Never 


18 


Don't Kno.v 


12 
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47. In your opinion, how often does this occur in order to influence 
a particular discretionary grant or contract? (48 responded.) 




Number 



Very often 

Often 

Neither often nor seldom 

Seldom 

Very seidom 

Never 

Don't knov/ 



48. When monitoring discretionary grants and/or contracts, is a 
telephone contact used as a monitoring method? (131 responded. If 
respondents cited "no," they were directed to question 51.) 



Number 


Yes 


112 


No 


16 


Don*t know 


3 


49. What items must be discuss*? in the telephone contact? 




103 provided narrative responses. 




50. How frequently are these calls made? (110 responded.) 






Frequency 


Number 


Monthly 


12 


Quarterly 


9 


Semiannually 


10 


Annually 


11 


Other 


68 
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51. Is an on-site visit used to monitor discretionary grants and/or 
contracts? (129 responded. If respondents cite . '-no," they were 
directed to question 54.) 


■ Wumber 


Yes 


89 




40 


52. GeneraUy, how often are discretionary grants and/or contracts 
monitored on site by your organizational unit? (83 responded.) 


Frequency 


Contracts 


E^^e^year ^ 


6 


Every 2 years 


6 


Every 3 years "p." 


1 


Every 4 years ^ 


1 


5 or more years (respondents were 
asked to provide an example) 26 


7 


Other 25^" 


5 


of 25 respond'^nts stated that some discretfonar/ grants are never monitored 




53. In general, what is the average length » f tfme it takes to prepare 
and issue final morJtoring reports to the grantee or contractor 
after a monitoring visit is completed? (82 responded.) 


Frequency 


Contracts 


1-90 days gg 


21 


3 months but less than 6 months ^ 


0 


6 months but less than 1 year 3 


1 


1 year to 3 years " ^ 


0 


More than 3 years (respondents were asked to 
provide an example) q 


1 


Never ^ 


1 


Other P - 


0 
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54. The following are some key events in the discretionary grants 
cycle. Please indicate to what extent you believe your organiza- 
tional unit has a problem accomplishing each event. (125 
responded. If no event was a "serious" or ''very serious problem," 
respondents were directed to question 56.) 



Event 


No 

problem 


Minor 
problem 


Moderate 
problem 


Serious 
problem 


Very 
serious 
problem 


Identify relative order of 
importance among program 
areas to receive grants 


44 


23 


13 


20 


14 


Develop and issue notice of 
closing dates 


32 


26 


19 


23 


15 


Send gr?.it application 
materi'c s to interested 
parties in a timely manner 


42 


16 


27 


19 


14 


Peer reviewer (field reader) 
selection 


28 


26 


34 


17 


14 


Manage peer review panels 


59 


31 


22 


6 


3 


Negotiate with applicants 


56 


26 


19 


8 


6 


Monitor corrective actions 


34 


19 


25 


23 


13 


Evaluate grant performance 


22 


8 


31 


36 


22 
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55. Respondents v-ere asked to list up to 2 events, in question 54, 
they considered most serious and lo explain what caused the 
problem. 

78 respondents cited at least one event they considered most serious and 
explamed what caused the problem. 

56. The following are some key events in the contracting eye'*' 
Please indicate to what extent you believe your organizational unit 
has a problem accomplishing each event. (79 responded. no event 
was a "seri< us" or "very serious" problem, respondents were sent 
to question 58.) 



Event 


No 

problem 


Minor 
problem 


Moderate 
problem 


Serious 
problem 


Very 
serious 
problem 


Identify relative order of 
importance among program 
areas to receive contracts 


36 


11 


12 


10 


5 


Prepare and transmit request 
lor contract to Grants and 
Contracts Service 


26 


19 


16 


5 


7 


Develop request for proposals 
(RFPs) 


32 


14 


16 


7 


7 


Peer reviewer selection 


32 


23 


9 


4 


5 


Manage peer review panels 


50 


14 


6 


2 


1 


Monitor corrective actions 


30 


16 


9 


6 


7 


Evaluate contract performance 


30 


10 


11 


9 


10 



57. Respondents were asked to list up to 2 events, in question 5S, 
they considered most serious and to explain what caused the 
problem. 

28 respondents cited at least ono event they considered most serious and 
explamed what caused the problem. 
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58, Is the distribution and administration of formula grants an 
essential part of or important to fulfilling your job-related duties? 
(182 responded. Respondents who ci^ed "no" were seat to question 
65.) 



Number 


Yes 


85 


No 


97 


59. Generally, how often are formula grants monitored on site by 


yoar organizational unit? (83 responded.) 




Frequency 


Number 


Every year 


33 


Every 2 years 


10 


Every 3 years 


11 


Every 4 years 


10 


Five or more years 


7 


Never 


8 


Other 


4 


60. In general, what is the average length of time ^.t takes to prepare 


and issue final monitoring reports to the grantee after a monitoring 


visit is completed? (74 responded.) 




Frequency 


Number 


1-90 days 


50 


3 months but less than 6 months 


8 


6 months but less than 1 vear 


4 


1 year to 3 years 


11 


More than 3 years 


0 


Other 


1 



77 
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61. The foUov'ing are some key events in the formula grant cycle. 
Please indicate to what extent you beUeve your organizational unit 
has a problem accompUshing each event. (83 responded.) 



Event 


No 

problem 


Minor 
problem 


Moderate 
problem 


Serious 
problem 


Very 
serious 
problem 


Review stale plans 


41 


13 


11 


10 


3 


Approve slale plans 


40 


16 


10 


6 


4 


Compule award 
amount 


42 


13 


6 


3 


2 


Issue award 


37 


16 


7 


7 


1 


Monitor compliance 


9 


8 


13 


28 


19 



62. Respondents were asked to list 1 event, in question 61, they con- 
sidered most serious and to explain what caused the problem. 

40 of 54 respondents cited "monitor compliance" as the most serious 
problem and explained the causes. 

63. In you*- opinion, how often do grantees fulfill requirements sat- 
isfactorily? (80 responded. If i Bspondent cited "always or almost 
always" or "most of the time," we sent them to question 65.) 



— ' Number 


Always or almost always 






5 


Most of the time 






44 


About half the time 






20 


Some of the time 






9 


Never or hardly ever 
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64. Inability to satisfactorily fulfiU grant requirements may result 
from poor grantee performance or inadequate agency administra- 
tion of the grant. In your opinion, to what extent do each of the 
following factors account for such unsatisfactory performance? 
(34 responded.) 



Faci«r 


Very great 
extent 


Great 
extent 


Moderate 
extent 


Some 
extent 


Little or 
no extent 


Don't 
know 


Inadequale performance by grantee 


3 


9 


12 


9 


0 


1 


Lack of OSERS staff to monitor grantees 


14 


16 


0 


1 


1 


1 


OSERS staff assigned to positions without proper training or 
qualification*^ 


8 


12 


5 


3 


3 


2 


Inadequate system for assunng that corrective actions or 
recommendations made in monitoring reports are implemented 


9 


13 


4 


7 


0 


1 


Lack of technical assistance provided by OSERS staff 


12 


12 


3 


3 


2 


1 


Lack of program guidance provided by OSERS staff 


14 


11 


2 


3 


2 


1 



Q v\l i £>G ^^-^^ carrying out your unit's operations, adequate siipplies and 

V . OUppiieS, equipment are important. How often do you have problems in 

Equipment, and obtaining adequate supplies and equipment for your organizational 

Services ^^^^ responded. If respondents cited "never or hardly ever," 

we sent them to question 68.) 



Number 


Never or hardly ever 


35 


Some of the time 


41 


About half the time 


if 


Most of the time 


56 


Always or almost always 


34 
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66. Respondents were asked to please identify one item most diffi- 
cult to obtain. 



142 provided narrative responses. 

67. To what extent do you attribute the problems in obtaining sup- 
pUes and equipxnent to each of the foUowing factors? (147 
responded.) 



Factor 


Very great 
extent 


Graat 
extent 


Moderate 
extent 


Some 
extent 


Little or 
no extent 


Don't 
know 


Lack of Authority to obtain supplies 


48 


22 


14 


10 


22 


15 


Overburdening procedures/reQu'ations 


28 


26 


17 


16 


20 


23 


Budget restrictions 


72 


26 


11 


13 


6 


15 


Other 


24 


8 


1 


0 


0 


2 



63. GeneraUy,'how often do you have problems in obtaining ade- 
quate external services (such as expert-, for panels, consultants, 
etc.) for carrying out your responsibiUties? (185 responded. If 
respondents cited "not appUcable" or "never or hardly ever," ^ 
sent them to question 70.) 



we 









Number 


Not applicable 




50 


Never or hardly ever 




48 


Some of the time 




40 


About half of the time 




16 


Most of the time 




19 


Always or almost always 




12 



69. To what extent do you attribute the problems in obtaining 
external services to each of the following factors? (86 responded.) 




Factor 



Lack of authority to purchase services 
Overburdening proce dures/regulations 
Budget restrictiopc — ~— — 
Other ~~ ~ ^ 



Very great 
extent 



25 



16 



Great 
exten t 

"l8 



Moderate 
extent 



Some 
extent 



Little or 
no extent 



Don't 
know 



11 



11 



15 



15 



39_ 
23 



18 
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VL Organizational 
Performance 



For the purposes of the following questions, organizational performance 
IS defined as how well your organizational unit as a whole — not individ- 
uals—provides services in ternis of efficiency (productivity, timeliness, 
quality, etc.) 

70. Do you have any of the following kinds of documents which 
include organizational performance measures? (182 r'^sponded. 
Respondents who cited "individual unit work plan, gency or 
organizational workplan," or "both of the above" w e sent t^ ques- 
tion 72, while respondents who cited "don't know" were sent to 
question 73.) 



Number 


Individual unit work plan{s) 


40 


Agency or organizational work plan(s) 


13 


Both of the above 


47 


Don't know 


28 


None of the above 


54 
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71. If organizational perfonnance measures do not exist fcr your 
unit, describe the approach you use to determine how efficiently 
you are operating. (After respondents described their approach, we 
sent them to question 82.) 

52 provided narrative responses. 

72. In your work plan(s), what specific activities are me^.sured for 
performance? (e.g., grants and contract awarded, monitoring visits 

rformed, regulations issued, etc.) 

92 provided narrative «*esponses. 

73. Do you use the foUoWng performance measures to assess the 
organizational performance of your unit? (119 responded.) 




Performance measure 



Productivity (i.e.. ratio of staff days to items produced and/or 
services pr ovided) ' 

Quality " ~ 



28 



76 



Timeliness 



87 



26 



User satisfaction 



107 



10 



Other 



55 



44 



10 



74. Over the last 3 ye .rs, h( sed on the performance measures men- 
tioned m question 73 and/or other facton;, how would you classify 
the organizational performance of your unit? (125 responded 
Respondents citing "performance good and constant or no change," 
performance poor and constant or no change," or "don't know" 
were sent to question 77. Respondents citing "perfonnance poor 
and declining" were sent to question 76.) 





Number 


Perfo'TTiance good and improving 


33 


Performance good and constant or no change 


42 


Performance poor and constant or '^hange 


11 


Performance poor and declining 
Don ♦ know 


25 


Perforrtrance good and declining 


13 
1 
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75. If performance oii oome measures has shown improvement, 
improved performance may have been achieved at the expense of 
timeliness and/or quality. In your opirion, do you think this has 
happened in your organizational unit? (33 responded and were 
directed to question 77.) 



Improved performance at the expense of ... 


Yes 


No 


Timeliness 


10 


23 


Quality 


8 


24 



76. If, in your opinion, the organizational performance of your unit 
has been declining, indicate to what extent each of the followirag is 
a cause of this decline. (29 responded.) 



Reason 


Very great 
extent 


Gi iat 
extent 


Moderate 
extent 


Some 
extent 


Little or 
no extent 


Don't 
know 


Increased workload 


10 


9 


6 


2 


2 


0 


Staff reduction 


16 


4 


3 


2 


3 


1 


Loss of experienced staff and cof^'nuity 


14 


4 


4 


2 


3 


0 


Decreased staff morale 


23 


5 


1 


0 


0 


0 


Reorganization 


5 


3 


7 


3 


5 


1 


New legislative authority 


5 


3 


4 


3 


11 


0 


Lack of managerial direction 


13 


4 


6 


0 


3 


0 


Other 


10 


0 


0 


0 


0 


0 



77. What strategies does your unit use to implement organizational 
performance improvements? (123 respondents cited one or more 
strategy. If respondent cited "none," we sent them to question 82.) 







Number 


Performance plans 


67 


Performance goals 


51 


Evaluation/studies 


31 


Specific performance ir..provement projects (task force committees, work 




groups, etc.) 


57 


Employee participation projects (suggestion systems, quality circles, etc.) 


33 


Other 


15 


None 


15 



o 
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78. If your unit uses specific techniques to improve your organiza- 
tion's performan<;e, indicate which technique(s) you use and also 
indicate if yc u believe the technique(s) is successful or unsuccess- 
ful. (99 responded.) 





Technique 


If used, IS it successful or 
unsuccessful? 






ussd? 






Don't 
knov/ 


Technique 


No 


Yes 


Successful 


Unsuccessful 


" echnology improvement 


32 


64 


16 


2 




Staff development 


44 


54 


38 


5 


11 


Change In work methods 


59 


38 


27 


4 


6 


Improving mechanisms tor employee 
accountability 


49 


46 


24 


15 


6 


Use of employee Incentives 


70 


29 


15 


5 


6 


Quality of wcklife improvements 


78 


20 


9 


6 


5 


Change in management personnel 


55 


38 


13 


13 


10 


Change in management or 
supervisory methods 


62 


32 


11 


12 


6 


Change in work environment 


67 


27 


7 


16 


4 


Other 


1 


4 


4 


0 


0 
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79. Respondent was asked to choose one articular technique from 
question 78 that was identi'^^d as being successful and to explain 
why it has beeii successful. 

69 provided narrative responses. 

80. If respondent identified any techniques in question 78 as being 
unsuccessful, we asked them to explain why for one technique. 

34 provided narrative responses. 

81. Listed below are conditions that mc v hinder the organizational 
performance of your unit. Respondents were asked if the following 
conditions exist in their unit and the extent the condition hindered 
the organizational performance of their unit programs? (104 
responded.) 









If ves, the extent it hinders performance 




Ccndition 


Does it exist? 
No Yes 


^'ery great 
extent 


Great 
extent 


Moderate 
extent 


Some 
extent 


Little or 
no extent 


Don't 
know 


Personnel ceilings 






31 


20 


16 


12 


7 


3 


Budget reductions 


14 


84 


40 


22 


8 


7 


3 


3 


Lack of OAS support 


22 


76 


40 


12 


11 


6 


0 


5 


Lack of support within your component 


54 




10 


9 


14 


6 


1 


4 


Siaff resistance to change 


49 


51 


5 


9 


16 


18 


0 


2 


Employee turnover rate 


47 


53 


12 


17 


14 


4 


5 


1 


Manager turnover rate 




33 


16 


20 


8 


7 


4 


1 


Multiple or conflicting perforno::nce goals 




51 


17 


13 


14 


6 


0 


n 


Lack of s pport services 


26 


77 


3d 


22 


10 


7 


1 


2 


Inadequately 'rained staff 


42 


58 


1 ' 


20 


11 


10 


1 


2 


Physical barriers to handicapped staff 


o4 


33 


10 


8 


9 


3 


1 


2 
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VIL Overall Views y^^^ opinion, has the Assistant secretary's uveraU manage- 

ment approach had a positive or negative effect on the day-to-day 
management of your unit? (184 responded.; 







Number 


Very positive effect 




2 


Positive effect 




7 


No effect 




17 


Negative eff3ct 




70 


\'ery negative effect 




76 


Don't know 




12 



83. Please identify up te two current operational or rwgrammatic 
problems, if any, that adversely affect your unit? 



160 identified at least one operational or programmatic problem that 
adversely affected their unit. 

84. If you could focus on solving only one p/oblem within OSERS, 
what would that problem be? 

175 identified at least one problem within osers they would focus on 
solving. 
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Note: Questions 1 and 2, employment data of state vocational rehabilita- 
tion directors, are excluded from the summary. 

These inteiviews focused on (1) the leadersh^^ 'Provided by the Offi'je of 
the Assistant Secretary (gas) and RSA; (2) their responsiveness to state 
needs; and (3) the quality of services provided. Unless otherwise noted, 
tne total number of respondents was 51. Percent column may not add tc 
100 due to rounding. 



3. One of the functions of the Office of the Assistant Secretary is to 
provide program leadership and direction by establishing national 
program goals and objectives for handicapped persons- In your 
opinion, how well has this Office done in establishing national goals 
and objectivee? 







Number 


Percent 


Very well 


2 


4 


Wei! 


5 


10 


Neither well nor poorly 


11 


22 


Poorly 


18 


35 


Very poorly 


15 


29 


Don't know 


0 


0 


No basis to iuoge 


0 


0 


4. Reg^ iless of how you may feel aN)ut these goals and objectives, 
how w^.x! does the Office of the Assistant Secretary or RSA communi- 
cate to you these national program goals and objectives? 






Numbei 


Percent 


Very well 


1 


2 


Well 


10 


20 


Neither well nor poorly 


9 


18 


Poorly 


16 


31 


Very poorly 


15 


29 


Don*t know 


G 


0 


No basis to judge 


0 


0 



1. Progidin Direction 
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5. RSA has been charged by the RehabUitation Act of 1986 with 
establishing and maintaining a state and federal program for voca- 
tional rehabiUtation. In your view, how weU has rsa fulfiiled its role 
as a partner with the states in providing and enhancing rehamUta- 
tive services? (If state directors answered "poorly" or "very 
poorly," they were referred to question 6. All other respondents 
were re jrred to question 7.) 







Number 


Percent 


Very well 




0 


0 


Wei! 




5 


10 


Poorly 




23 


45 


Very poorly 




22 


43 


Don't know 




0 


0 


No ba;5is to judge 




1 


2 



6. Is there any specific instance you can recall where rsa did not 
adequately fulfill itc role as a partner with the states? 

45 state vocational rehabilitation directors provided examples where 
RSA did not adequately fulfill its role as a partner with the states. 



11. Policy Guidance <^^neraUy, how are r policies which impact on your state pro- 

gram communicated to you? (50 state directors responded.) 







Number 


Orally 


3 


Written memcanda or directives 


47 


Other 


0 
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8. As you probably know, rsa issued the "Rehabilitation Services 
ManuaJ." in 1974 as a primary source of program policies and adm*ii- 
istrative policy guidance for use by the states and RSA regional 
offices. However, in 1983, another version of this manual was 
issued.* It is our un derstanding that certain states use the 1974 
m^rnual rather than the more recent 1983 manual to assist in admin- 
istration of their programs. Which of these two manuals (the 1974 
or 1983 version) do you and your staff use most frequently and 
please explain why? 





Number 


Percent 


1974 


31 


61 


1983 


2 


4 


Both 


1 


2 


Neither 197'! nor 1983 


7 


14 


Not sure, possibly 1983 


4 


8 


Oon'* know 


6 


12 



9. Other than the Rehabilitation Services Manual, what other fed- 
eral policy guidance is provided to you by RSA concerning rehabilita- 
tive services matters? (jttespond?int watj asked to identify what RSA 
organizational unit provides the information.) 

50 state vocational rehabilitation directors identified other federal 
policy guidance provided Dy rsa. 

10. In an overall ? ense, is the written policy guidance you receive 
from RSA timeJy? 









Number 


Percent 


Yes 


6 


12 


No 


43 


84 


Other 


1 


2 


Don't know 


1 


2 



^ Many state directors said that the 1983 version was never issued by the Department. This was Irter 
confirmed by an RSA ofncial. 
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11. How would you characterize the usefulness of the policy guid- 
ance you receive from rsa? (If state directors answered "very use- 
ful" or "don't know," they were referred to question 13.) 





Numijer 


Percent 


Very useful 


2 


4 


Moderately useful 


33 


65 


Not very useful 


14 


27 


useless 


0 


0 


Don't know 


2 


4 



12. In your opinion, what if anything neeui to h-^ done to further 
Laprove the usefuhiess of the policy guidance \ provides to your 
state? 

46 state vocational rehabilitation directors provided suggestions that 
could further improve the usefulness of the policy guidance rsa pro- 
vides to their state. 



Note: Questions 13 through 17 concern the quali^ of written explana- 
tions or interpretations of federal policy the states receive from rsa. 
These explanativ/ns or interpretations of policy would be found in rsa 
regulations, explanatory memos, directives, policy statements, etc. 

13 do you tl'inlc written rsa guidance is TOO DETAILED, NOT 

DETAILED ENOUGH, or ABOUT RIGHT? 





Number 


Percent 


Too detailed 


6 


12 


'bout right 


25 


49 


Not detailed enough 


18 


35 


Don't know 


2 


4 
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14 do 2iLik written RSA guidance is CURRENT or OUT- 
DATED? (If state directors answered "current'' or "don't know," 
they were referred to question 160 







Number 


Percent 


Current 


12 


24 


Outdated 


37 


73 



Don't know 2 4 



15. . • . if you believe rsa guidance is outdated please explain why 
you feel that way, 

31 stat^ vocational rehabilitation directors provided explanations on 
why they believe rsa guidance is outdated. 

16 do you think written RSA guidance is TOO TECHNICAL, NOT 

TECHNICAL ENOUGH, or ABOUT RIGHT? 





Number 


Percent 


Too technical 


3 


6 


About right 


33 


65 


Not technical enough 


11 


22 


Don't know 


3 


6 


Other 


1 


2 


17. In an overall sense, do you think this guidance taken as a whole 
is CLEAR or UNCLEAR? 








Number 


Percent 


Clear 


18 


35 


Unclear 


28 


55 


Don't know 


5 


10 
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TIL Responsiveness ^^^^ experience, have RSA staff generally been laiowledgoable 

about the kinds of rehabilitation ^rvices needed in your state? 









N'-moer 


Percent 


Yes 


19 


37 


No 


32 


63 



Don't know 0 0 



19, Based on your experiences, how well do RSA staff work with offi- 
cials and <?taff in your state to resolve problems? 






Number 


Percent 


Very well 


14 


27 


Well 


15 


29 


Poorly 


18 


35 


Very poorly 


4 


8 


Don't know 


0 


0 



20, • ♦ ♦ are you aware of RSA staff who lack the necessary rehabilita- 
tive services expertise to perform their assigncvl duties and respon- 
sibilities? (If state directors answered "no" or "Jon't know," they 
were referred to question 24.) 









Number 


Percent 


Yes 






32 


63 


No 






16 


31 


Don't know 






3 


6 
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21. In y^ar opinion, do you believe this lack of expertise results 
from RSA staff being inexperienced, improperly trained, both inex- 
p( rienced and improperly trained, or some rather reason? (All 32 
state directors who were asked this question responded.) 







Number 


Inexperienced 


2 


Improperly trainee 


3 


Both inexperienced and improperly trained 


23 


Other 


A 



22 has this had a positive, negative, or no effect on your ability 

to achieve your state program gr -^Js? (If respondents answered 
"positive," "no effect," or '*don't know," they were referred to ques- 
tion 24. All 32 state directors who were asked this question 
responded.) 







Number 


Percent 


Positive 


0 


0 


Negative 


28 


55 


No effect 


4 


8 


Don't know 


0 


0 



23. Could you give us an example the negative effect this situa- 
tion has had on your state program? 

All 28 state vocational rehabilitation directors who were asked this 
question provided examples of negative effects particular situations had 
on their state programs. 
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24. How effective has the RSA staff been in providing any technical 
assistance (i.e., applying specific program knowledge and/or spe- 
cial skills) requested by your office? 









Number 


Percent 


Very effective 




3 


6 


Effective 




10 


20 


Neither effective nor ineffsctive 




12 


24 


Not effective 




23 


45 


Don't know 




1 


2 



!o basis to judge 2 4 



25. Ovejt the last three years, approximately how many times have 
you requested and received on-site technical assistance (T/A) In 
your state from RSA staff? 



20 states said "none or one" T/A visit. 
19 states said •*2 to 9" T/A visits. 
3 states said **21 to 36" T/A visits. 
9 states s^d "other."* 



26. Within the same three year perio<i have you requested on-site 
technical assistar but had it denie^ i by the rsa Central Office? (45 
state directors responded. If respondents answered "no" or "don't 
know," they were referred to question 29.) 





Number 


Percent 


Yes 


31 


69 


No 


13 


29 



Don't know 1 2 



' These states said no site visks were requested \ ^use (1) they knew the visits would be denied by 
OSERS, or (2) RSA staff was ine^-pcrienced or unqualified. 
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27. Approximately how many times was on-site tecL^dcal assistan^'.e 
(T/A) requested but denied by rsa within the last three years? (All 
31 state directors who were asked this question responded.) 

25 states said 1-10 requests denied. 

5 states said more than 10 requests denied. 

1 state said "many." 

28. For what reason(s) do you believe this (these) requested visit(s) 
was denied? 

33 of 34 state vocational rehabilitation directorb responding believed 
that travel restrictions was the primary rejibun why their requests for 
on-site technical assistance were denied. 



IV Training Does rsa provide training to your staff? (If responds iits 

^ answered **no" or "don't know," they were referred to (question 32.) 







Number 


Percent 


Yes 


4 


8 


No 


47 


92 


Don't know 


0 


0 



30. How would you rate the quaUty of training provided to your 
state by rsa? (If respondents answered "good," "don't know," or 
"no basis to judge," they were referred to question 32.) (All 4 state 
directors who were asked this question responded.) 



Number 



Good 1 

Adequate 1 



Poor 



Don't know 
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31, In your opinion, how could the quality of training be improved? 
(3 of 4 state directors who were asked this question cited one or 
more,) 





Number 


Upgraded curriculum 


1 


Better trained instructors 


2 


Greater accessibility to fining (i.e„ more money for iravel) 


1 


Other 


1 



V. RSA Management ^^^^ several years, RSA's central office has had several 

^ managerial positions vacant for expended periods of time or r . 

managerial posi * .is hrve been filled with people functioning ;u aii 
"acting" capacity, Ar. vc u aware of this situation? (State directoni 
answering "no" or "don't lOiow" were referred to question 350 















Number 


Percent 


Yes 




51 


100 


No 




0 


0 



33. Has this situation within RSA's centrai office had a positive, neg- 
ative, or no effect on achieving your state program goals? State 
directors answering "positive," "no effect," or "don't know" were 
referred to question 35.) 







Number 


Percent 


Positive 


0 


0 


Negative 


37 


73 


No eUect 


12 


24 


Don't know 


2 


4 
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34. Could you give us one example of the effect \/acant managerial 
positions at the RSA Central Office or such positions filled by an 
individual in an "acting" capacity has had on your state program? 

34 state vocational rehabilitation directors provided examples of nega- 
tive effects the vacant managerial positions or individuals in an "acting" 
capacity at the RSA Central Office had on their state program. 

35. Similarly, are you aware of vacant managerial positions or "act- 
ing managers" at the rsa regional office serving your state? (State 
directors answering "no" were referred to question 38.) 




36. What effect has staffing managerial positions in the rsa 
regional office with "acting" persorjtiel or leaving positions vacant 
had on achieving your state program goals? (State directors answer- 
ing "positive," "no effect," or "don't know" were referred to ques- 
tion 38, All 36 state directors who were asked this question 
responded.) 







Number 


Positive 


0 


Negative 


23 


No effect 


13 


Don't know 


0 



37. Could you give us one example of the effect vacant positions in 
the RSA r egional office or such positions filled by an individual in an 
"acting" capacity has had on your state program? 

22 state vocational rehabilitation directors provided examples of nega- 
tive effects that vacant positions, or such positions filled by an individ- 
ual in an "acting" capacity, at the rsa regional offir^ had on their state 
program. 
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VT Pro^rfl m ^"^^^ program 11^ onitoring usually performed? (51 state 

• A i vJ&i <^ll directors cited one or more method.) 

Monitoring 





Method 


Number 


By telephone 


22 


By on-sile visits 


30 



Other 



39. Over the last three years, approximately how many times have 
on-site monitoring visits been performed in your state by KSA staff? 
Corespondents indicated "none" or "don't know," they were 
referred to question 41.) 

4 states indicated "none." 

10 states indicated "1 visit." 

28 states indicated "2 or 3 visits." 

8 states indicated "4 or more visits." 

1 state indicated "don't know." 

40. In regard to the most recent rsa monitoring visit, how soon after 
the monitoring visit was completed did you receive a monitoring 
visit report? (All 46 state directors who were asked this question 
responded.) 







Number 


Within 3 months 


32 


Within 6 months 


3 


Within 9 ranths 


1 


1 year or more 


1 


Never 


1 


Don't know 


1 


Other^ 


7 



^Respondents who indicated that a monitoring visil was recently conducted 
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VTT Othpr conclude, ii? your opinion, is there any issue regarding your 

V 11. V^llltJl ^^^^ relationship with the Office of Special Education and Rehabil- 

itative Services and/or rsa that you would like to discuss? 

43 state vocational rehabilitation directors described additional issues. 
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Note: Questions 1 and 2, employment data of state special education 
directors, are excluded from the summary. 

These interviews focused on (1) the leadership provided by the Office of 
the Assistant Secretary (oas) and osep; (2) their responsiveness to state 
needs; and (3) the quality of services provided. Unless otherwise noted, 
the total number of respondents was 51. Percent colunms may not add 
to 100 due to rounding. 



I. Program Direction ^' functions of the office of the Assistant Secretary Is to 

provide program leadership and direction by establishing national 
program goals and objectives for persons with handicapping condi- 
tions. In your opinion, how well has this Office done in establishing 
national goals and objectives? 





Number 


Percent 


Very well 


9 


18 


Well 


24 


47 


Neither well nor poorly 


10 


20 


Poorly 


6 


12 


Very poorly 


1 


2 


Don't know 


0 


0 


No basis to judge 


1 


2 



4. Regardless of how you may feel about those goals and objectives, 
how well does the Office of the Assistant Secretary or osep commu- 
nicate to you these national program goals and objectives? 






Number 


Percent 


Very well 


6 


12 


Well 


22 


43 


Neither well nor poorly 


10 


20 


Poorly 


11 


22 


Very poorly 


2 


4 


Don't know 


0 


0 


No basis to judge 


0 


0 
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TT PnHr>^r rniHpnpp 5. GeneraUy, how are OSEP poUcies which impaet on your state pro- 

11. rOUty UUlUcUlce communicated to you? (51 state directors cited one or more 

method.) 



Number 


Orally 


17 


Written memoranda or directives 


38 



Other 



6. What kind of federal policy guidance is provided to you by OSEP 
concerning special education matters? (State directors were asked 
to identify the OSEP organizational unit proviuing the information.) 

51 state special education directors described the kind of federal policy 
guidance provided by osep. 

7. In an overall sense, is the written policy guidance you receive 
from OSEP timely? 




8. How would you characterize the usefulness of the policy guid- 
ance you receive from osep? (If state directors answered "very use- 
ful" or "don't know," they were reft>rred to question 10.) 









Number 


Percent 


Very useful 




7 


14 


Moderately useful 




20 


39 


Not very useful 




18 


35 


Useless 




4 


8 


Don't know 




2 


4 
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9. In your opinion, what if anything needj to be done to further 
improve the usefulness of the poUey guidance osep provides to your 
State? 



All 42 state special education directors who were asked this question 
provided suggestions that could further improve the usefulness of osep's 
policy guidance provided to their states. 

Note: Questions 10 through 14 concern the quality of written explana- 
tions or interpretations of federal policy the states receive from osep. 
These explanations or interpretations of policy would be found in osep 
regulations, explanatory memos, directives, policy statements, etc. 

10 do you think written p guidance is TOO DETAILED, NOT 

DETAILED ENOUGH, or ABOUT RIGHT? (49 state directors 
responded.) 






Number 


Percent 


Too detailed 


5 


10 


About right 


23 


47 


Not detailed enough 


15 


31 


Don't know 


3 


6 


Varies 


3 


6 



11 do you think written osep guidance is CURRENT or OUT- 
DATED? (49 state durectors responded.) 





Number 


Percent 


Current 


28 


57 


Outdated 


15 


31 


Don't know 


6 


12 
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12 if you believe OsEP guidance is outdated please explain why 

you feel that way. 

17 state special education directors provided explanations on why they 
believed osep guidance was outdated. 

15 do you think written oSEP guidance is TOO TECHNICAL, NOT 

TECHNICAL ENOUGH, or ABOUT RIGHT? (49 state directors 
responded.) 





Number 


Percent 


Too technical 


7 


14 


About right 


29 


59 


Not technical enough 


12 


25 



Don't know 



14. In an overall sense, do you think this guidance taken as a whole 
is CLEAR or UNCLEAR? (48 state directors responded.) 







Number 


Percent 


Clear 


26 


54 


Unclear 


21 


44 


Don't know 


1 


2 



TTT RpQr»nn<iiA7PnP<?c ^^"^ experience, have osep staff generaUy been knowledge- 

Ill. iXebpUIlbl VtJlltJis^j^ , , Rhoiit. the kinds of special education programs needed in youi 



able about the kinds of special education programs needed in your 
state? 









Number 


Percent 


Yes 


18 


35 


No 


29 


57 


Don't know 


4 


8 
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16. Based on your experiences, how well do OSEP staff work with 
officials and staff in your state to resolve problems? 





Number 


Percent 


Very well 


7 


14 


Well 


21 


41 


Poorly 


17 


33 


Very poorly 


4 


8 


Don't know 


2 


4 



17 are you aware of osep staff who lack necessary special educa- 
tion expertise to perform their assigned duties and responsibUi- 
ties? (If state directors answered "no" or "don't know," they were 
referred to question 21.) 



Number 



Yes 



Percent 



17 



No 



33 



24 



47 



Don't know 



10 



20 



18. In your opinion, do you believe this lack of expertise results 
from OSEP staff being inexperienced, improperly trained, both inex- 
perienced and improperly trained, or some other reason? (All 17 
state directors who were asked this question cited one or more 
reason.) 



Number 


inexperienced 


3 


Imprope/ly trained 


1 


Both Inexperienced and Improperly trained 


12 


Other 


3 
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19 has this had a positive, negative, or no effect on your ability 

to achieve your state program goals? (All 17 state directors who 
were asked this question responded. State directors answering 
"positive," "no effect," or "don't know" were referred to question 
210 





Number 


Positive 


0 


Negative 


12 


No effect 


4 


Dor/t know 


1 



20. Could you give us an example of the negative effect this situa- 
tion has had on your state program? 

All 12 state special education directors who were asked this question 
provided examples of negative effects particular situations had on their 
state program. 



21. Does OSEP provide technical assistance to your state? (i.e., apply- 
ing speciflc program knowledge and/or special skills) (47 state 
directors responded.) 







Number 


Percent 


Yes 


17 


36 


No 


30 


64 



22. What kind of tec' weal assistance is provided to you by osep? 

39 state special education directors described the kinds of technical 
assistance osep provided. 
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^3. What methods does osep use in providing technical assistance to 
your state? (46 respondents cited one or more method.) 



T^. . — — Number 

Telephone — 



Memos & directives 



42 



Letters specific to your state 
On-site visits 

National or regional conference s 
Other " - 



35 



39 



35 



43 



27 



24. How would you rate the amount of technical assistance pro- 
vided to your state by osep? (47 state directors responded.) 




Too much 



About right 



Not enough 



Don*t know 



Number 


Percent 


0 


0 


10 


21 


37 


79 


0 


0 



25. Over the last three years, approximately how many times have 
you requested and received on-site technical assistance (T/A) in 
your state from osep officials or staff? 

41 states said "none." 
7 states said "1 to 2" T/A visits. 
2 states said "3 to 5" T/A visits. 
1 state said "G to 8" T/A visits. 
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26. Within the same three year period, have you requested on-site 
technical assistance and had it denied by osep? (State directors 
answering "no" or "don't know" were referred to question 30.) 





Number 


Percent 


Yes 


6 


12 


No 


45 


88 


Don't know 


0 


0 



27. Approximately how many times was on-site technical assistance 
requested but denied by osep within the last three years? (All 6 
state directors who were asked this question responded.) 

3 states said 1 request denied. 

3 states said 3 requests denied. 



28. For what reason(s) do you believe that this (these) requested 
visit(s) was denied? (5 of 6 state directors who were asked this 
question cited one or more reason.) 





Number 


Budget restrictions 




4 


Lack of authority from OSEP director to authorize visits 




2 


Other 




1 



29. Over the past several years, osep has had several managerial 
positions vac**.nt for extended periods of time or certain managerial 
positions have been filled with people functioning in an "acting" 
capacity. Are you aware of this situation. (If state directors 
answered "no," they were referred to question 33.) 







Number 


Percent 


Yes 


50 


98 


No 


1 


2 



IV. OSEP Management 
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30. Has this situation within OSEP had a positive, negative, or no 
effect on achieving your state program goals? (If respondents 
answered "positive," "no effect," or "don't know," they were 
referred to question 33.) (AU 50 state directors who were asked this 
question responded.) 







Number 


Percent 


Positive 




0 


0 


Negative 




31 


62 


No effect 




17 


34 


DonH know 




2 


4 



31. Could you give us one example of the effect vacant managerial 
positions within QSEP or such positions filled by an individual in an 
"acting" capacity has had on your state program? 

27 state special education directors provided example j of negative 
effects vacant managerial positions or individual • in an "acting" capac- 
ity within OSEP had on their state program. 



V. Program Monitoring program monitoring usually performed? (51 state 

° directors cited one or more method.) 



Numhfir 


By telephone 




12 


By Oivsite visits 




49 


Other 




13 
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33. Over the last three years, approximately how many times have 
on-site monitoring visits been performed in your state by osep offi- 
cials or staff? (If respondents answered "none," they were referred 
to question 35.) 

12 states indicated "none/' 
38 states indicated "1 visit." 
1 state indicated "2 visits." 



34. In regard to the most recent osep moiutoring visit, how soon 
after the monitoring visit was completed did you receive a monitor- 
ing visit report? 



Number 


Within 3 months 


1 


Within 6 months 


9 


Within 9 months 


1 


Within 12 months 


2 


12 to 24 months 


11 


Over 24 months 


2 


Other (at the time we made the calls. 20 of these 25 states had not received 


25 


a final report from their most recent monitoring visit) 



35. In conclusion, is there any other issue regarding your state's 
relatio^^'hip with the Office of Special Education and Rehabilita- 
tive Services and/or osep that you would like lo comment on? 

45 state specia; ducation directors described additional issues. 
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List of Data for Figures 



Table V.1: Response Rates by OSERS 
Components (Figure 4) 



Component 



OAS 



Number of 
respondents 



9 of 18 



RSA 



Response rate (%) 



50 



OSEP 



103 of 126 



82 



63 of 89 



NIDRR 



71 



12 of 17 



71 



Table V.2: Units With Written Plans 
(Figure 12) 



Total responded 



Number of 
respondents 



Respondents in units with written plans 



185 



Respondents with written plans who cited plan as useful 



109 



86 



Table V.3: Key OSERS Positions Vacant 
or Filled With Acting Personnel 
(Figure 16) 



Month/year 



Key OSERS 
Positions 



February 1988 



Positions vacant 
or acting 



56 



February 1989 



21 



56 



14 
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UNITED STATES DEPARTMENT OF EDUCATION 

OFFICE OF THE ASSISTANT SECRETARY 
FOR SPECIAL EDUCATION AND REHABILITATIVE SERVICES 



SEP 51^9 



Mr. Lawrence H. Thompson 

Assistant Comptroller General 

United States General Accounting Office 

Washington, D.C. 20548 

Dear Mr. Thompson: 

Thank you for the opportunity tc "oninent on the draft report to the 
Chairman, Subconmittee on Sele*-t Education, House Committee on 
Education and Labor, titled "Education Department* Observations 
on Office of Special Education and Rehabilitative Services." This 
informational report is based upon data obtained in response to a 
detailed survey instrument which was mailed to 250 staff in the 
Office of Special Education and Rehabilitative Services (OSERS) . 

Although we have questions about the methodology upon which the GAO 
report was based, many of the conclusions in the report are 
consistent with my own assessment of management problems in OSERS. 
In particular I have concerns regarding excess c<^ntralization of 
authority, lack of collegiality and meaningfully-shared decision- 
making, poor communications internally and externally, and problems 
with obtaining and allocating organizational resources. We 
recognize that the complex and persistent management problems of 
OSERS cannot be solved immediately. However, the new management 
team in OSERS considers returning sound management practices and 
improved morale to OSERS to be one of its highest priorities. 

It is important to note that despite the problems identified by 
GAO, OSERS nas continued to award and administer program 
appropriations of approximately $3.7 billion per year. Funds to 
grantees have been obligated on schedule and services to students 
and clients have not been interrupted. 

As a result of our review of the needs of OSERS, we are planning 
corrective actions to address areas relating to goal setting, 
management of human resources and the grant making process, and 
our relationship with the States. 

OSERS will develop a set of cross-cutting goals intended to provide 
a conceptual f ramf rfork for the administration of programs and the 
allocation and ase of Federal resources. These goals will 
complement and help guide the more specialized and shorter-term 
plans now used for budgeting, grants and contracts scheduling and 
management, program monitoring and the development of regulations. 
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I have already conducted a one-day retreat with my senior management 
tea-a to begin the process of developing OSERS-wide goals and objectives. 
We intend to establish a management system in OSERS that can measure our 
success in achieving these goals. I have also asked senior management 
officials of OSERS to meet with their key staff to develop additional 
goals and objectives for each of the OSERS components. These goals wi'l 
be dr\ >ioped in full consultation with the professional staff in the 
three OSERS components, and with the rehabilitation, special education 
and research communities. Rehabilitation Services Ccnunissioner Nell 
Carney, for ex«^aple, has already begun to solicit input from State 
agencies and other organizations on a strategic plan for RSA. 

The management relationships between the Office of the Assistant 
Secretary (OAS) and the OSERS components are another major area of 
ccr.cern. As a first step in improving management relationships, it is 
our intention to move to a more decentralized management style. My 
management philosophy has always been to give senior managers the 
authority to do their jobs and hold them accountable for the results. 
We have already taken several actions to pursue a more decentralized 
management approach. For example, most requests for travel no longer 
require the approval of the Assistant Secretary. This authority has 
been delegated to the individual component heads. 

I meet on a regular basis with senior management officials to review 
OSERS-wide issues and problems. Each of the component heads conducts 
similar meetings with their key staff. In summary, we are moving OSERS 
toward a nore collaborative management system. 

The report had substantial findings in the area of human resources 
management. Unfilled positions, positions occupied for long periods on 
an "acting" basis, lack of staff competence, and a high staff turnover 
rate were cited as problems. OSERS has never "hired up" to the present 
staff ceiling of 424 ETE. We are trying to improve our performance in 
filling permanent positions. RSA has just filled two critical Regional 
Ccnunissioner vacancies and expects to fill the remaining vacancy soon. 
We intend to discuss with the appropriate Department offices ways to 
expedite the recruitment of key personnel. 

We also believe that more specialized training for staff wo^'ld be 
desirable. The Horace Mann Learning Center has provided approximately 
4300 hours of managerial and administrative training to OSERS employees 
in FY 1988 and more than 7,000 hours through July 25, 1989. We will 
explore with the Office of Personnel other mechanisms for providing more 
specialized training to OSERS staff. We are also exploring methods of 
providing expanded staff development opportunities internally, A 
Department-wide Education Program Curriculum Ccnmiittee has been 
established to review the training needs of Education Program 
Specialists and those in related job series, and to recommend training 
and other development actions required to maintain their expertise. 
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Program accountability is a high priority of the Department. The 
Department is developing a series of interrelated program, management, 
and regulcxtory changes as part of an "Accountability Initiative" 
designed tc better measure the use and effect of Federal funds* B*or 
example, evaluation criteria for making new awards and continuation 
awards are baing reviewed to determine how grantee performance may be 
better linked to funding* The "Accountability Initiative*' is expected 
to result in more extencivc monitoring of grantees* in addition, it 
is our intention to place the monitoring of the EHA-B program on a more 
timely and systematic basis* Great progress has been made in reducing 
the backlog of final reports* We expect to make available shortly a 
prospective schedule ror EHA monitoring visits and believe that 
sufficient resources will be available to meet this schedule* 

Another area we plan to address is the provision of technical assistance 
to the States* The Office of Special Education Programs (OSEP) has 
initiated efforts to review the role of clearinghouses, institutes, 
regional resource centers and other projects that provide technical 
assistance to the field- OSEP will identify and implement strategies 
to better link, coordinate and expand OSEP technical assistance and 
leadership efforts to the field as well as ways to better interface with 
RSA, the National Institute on Disability and Rehabilitation Research 
and other offices within the Department of Education* 

The FY 1990 RSA workplan will include a technical assistance component* 
The new RSA Ccmmissioner regards the provision of timely technical 
assistance as a top priority because of its preventive qualities* 

We believe that our new management team, which includes three senior 
managers with extensive experience in State government, will effect 
changes which will improve relations with State agencies* Our planning 
activities will be designed so that our States partners will have full 
opportunity to have their views considered* 

I hope that this information will be useful in the preparation of your 
final report* 



Robert R* Davila 
Assistant Secretary 
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M^or Contributors to This Report 



Human Resources ^^^^^^ ^^-^ Assistant Director for Elementary and Secondary 

HiT/iQinn Educarion, (202) 245-9623 

division, William A. DeSamo, Assignment Manager 

Washington, D,C, Darlene M. Bell, Evaluator-in-Charge 

Susan L. Sullivan, Evaluator (Computer Science) 

Charles L Patton, Jr., Advisor 

John T. Carney, Senior Evaluator 

Dennis M, Gehley, Evaluator 
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U.S. General Accounting Office 
Post Office Box 6015 
Gaithersburg, Maryland 20877 

Telephone 202-275-6241 

The first five copies of each report are free. Additional copies are 
$2.00 each. 

There is a 25% discount on orders for 100 or more copies mailed to a 
single address. 

Orders must be prepaid by cash or by check or money order made 
out to the Superintendent of Documents.; 
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